2023-02-15 21:01:06,160 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-15 21:01:06,204 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=166, AvailableMemoryMB=4051 2023-02-15 21:01:06,467 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea 2023-02-15 21:01:06,476 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:06,477 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e, deleteOnExit=true 2023-02-15 21:01:06,477 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:06,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/test.cache.data in system properties and HBase conf 2023-02-15 21:01:06,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:06,479 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:06,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:06,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:06,480 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:06,579 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-15 21:01:06,953 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:06,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:06,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:06,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:06,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:06,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:06,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:06,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:06,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:06,961 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:06,961 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:06,962 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:06,962 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:06,962 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:06,963 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:07,478 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:07,482 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:07,745 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-15 21:01:07,893 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-15 21:01:07,907 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:07,952 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:07,990 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/java.io.tmpdir/Jetty_localhost_37799_hdfs____.frpz1f/webapp 2023-02-15 21:01:08,152 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37799 2023-02-15 21:01:08,164 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:08,164 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:08,661 WARN [Listener at localhost/42563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:08,758 WARN [Listener at localhost/42563] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:08,781 WARN [Listener at localhost/42563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:08,787 INFO [Listener at localhost/42563] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:08,792 INFO [Listener at localhost/42563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/java.io.tmpdir/Jetty_localhost_41723_datanode____5vp402/webapp 2023-02-15 21:01:08,908 INFO [Listener at localhost/42563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41723 2023-02-15 21:01:09,354 WARN [Listener at localhost/32939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:09,385 WARN [Listener at localhost/32939] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:09,396 WARN [Listener at localhost/32939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:09,398 INFO [Listener at localhost/32939] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:09,407 INFO [Listener at localhost/32939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/java.io.tmpdir/Jetty_localhost_39793_datanode____.ig6r2/webapp 2023-02-15 21:01:09,528 INFO [Listener at localhost/32939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39793 2023-02-15 21:01:09,544 WARN [Listener at localhost/45931] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:09,875 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2196a9ccae98b179: Processing first storage report for DS-c8973d95-6c83-479e-9bc7-4da43d4d1906 from datanode 9b953166-0088-4ef7-92a0-ce557616bc1a 2023-02-15 21:01:09,876 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2196a9ccae98b179: from storage DS-c8973d95-6c83-479e-9bc7-4da43d4d1906 node DatanodeRegistration(127.0.0.1:34913, datanodeUuid=9b953166-0088-4ef7-92a0-ce557616bc1a, infoPort=46477, infoSecurePort=0, ipcPort=32939, storageInfo=lv=-57;cid=testClusterID;nsid=1688094254;c=1676494867545), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 21:01:09,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe82f999fa4dc2a53: Processing first storage report for DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db from datanode 08d40c85-87d4-492b-95c4-349344948d89 2023-02-15 21:01:09,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe82f999fa4dc2a53: from storage DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db node DatanodeRegistration(127.0.0.1:39183, datanodeUuid=08d40c85-87d4-492b-95c4-349344948d89, infoPort=39907, infoSecurePort=0, ipcPort=45931, storageInfo=lv=-57;cid=testClusterID;nsid=1688094254;c=1676494867545), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:09,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2196a9ccae98b179: Processing first storage report for DS-e34eaa59-efaf-4a4e-bff1-30f2da70ed08 from datanode 9b953166-0088-4ef7-92a0-ce557616bc1a 2023-02-15 21:01:09,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2196a9ccae98b179: from storage DS-e34eaa59-efaf-4a4e-bff1-30f2da70ed08 node DatanodeRegistration(127.0.0.1:34913, datanodeUuid=9b953166-0088-4ef7-92a0-ce557616bc1a, infoPort=46477, infoSecurePort=0, ipcPort=32939, storageInfo=lv=-57;cid=testClusterID;nsid=1688094254;c=1676494867545), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:09,877 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe82f999fa4dc2a53: Processing first storage report for DS-360191ce-9831-4799-95d1-c453db880893 from datanode 08d40c85-87d4-492b-95c4-349344948d89 2023-02-15 21:01:09,877 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe82f999fa4dc2a53: from storage DS-360191ce-9831-4799-95d1-c453db880893 node DatanodeRegistration(127.0.0.1:39183, datanodeUuid=08d40c85-87d4-492b-95c4-349344948d89, infoPort=39907, infoSecurePort=0, ipcPort=45931, storageInfo=lv=-57;cid=testClusterID;nsid=1688094254;c=1676494867545), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:09,970 DEBUG [Listener at localhost/45931] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea 2023-02-15 21:01:10,059 INFO [Listener at localhost/45931] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/zookeeper_0, clientPort=51186, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:10,076 INFO [Listener at localhost/45931] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51186 2023-02-15 21:01:10,087 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:10,089 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:10,776 INFO [Listener at localhost/45931] util.FSUtils(479): Created version file at hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b with version=8 2023-02-15 21:01:10,776 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:10,778 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:10,781 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/hbase-staging 2023-02-15 21:01:11,111 INFO [Listener at localhost/45931] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-15 21:01:11,570 INFO [Listener at localhost/45931] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:11,603 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:11,603 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:11,603 INFO [Listener at localhost/45931] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:11,603 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:11,604 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:11,743 INFO [Listener at localhost/45931] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:11,813 DEBUG [Listener at localhost/45931] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-15 21:01:11,905 INFO [Listener at localhost/45931] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41737 2023-02-15 21:01:11,915 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:11,918 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:11,939 INFO [Listener at localhost/45931] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41737 connecting to ZooKeeper ensemble=127.0.0.1:51186 2023-02-15 21:01:11,983 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:417370x0, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:11,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41737-0x10059c97fdb0000 connected 2023-02-15 21:01:12,013 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:12,013 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:12,017 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:12,025 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41737 2023-02-15 21:01:12,025 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41737 2023-02-15 21:01:12,025 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41737 2023-02-15 21:01:12,027 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41737 2023-02-15 21:01:12,028 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41737 2023-02-15 21:01:12,034 INFO [Listener at localhost/45931] master.HMaster(444): hbase.rootdir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b, hbase.cluster.distributed=false 2023-02-15 21:01:12,103 INFO [Listener at localhost/45931] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:12,103 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:12,103 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:12,104 INFO [Listener at localhost/45931] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:12,104 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:12,104 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:12,108 INFO [Listener at localhost/45931] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:12,111 INFO [Listener at localhost/45931] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46537 2023-02-15 21:01:12,114 INFO [Listener at localhost/45931] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:12,121 DEBUG [Listener at localhost/45931] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:12,122 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:12,123 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:12,125 INFO [Listener at localhost/45931] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46537 connecting to ZooKeeper ensemble=127.0.0.1:51186 2023-02-15 21:01:12,131 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:465370x0, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:12,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46537-0x10059c97fdb0001 connected 2023-02-15 21:01:12,133 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:12,134 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:12,134 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:12,135 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46537 2023-02-15 21:01:12,135 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46537 2023-02-15 21:01:12,136 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46537 2023-02-15 21:01:12,140 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46537 2023-02-15 21:01:12,140 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46537 2023-02-15 21:01:12,153 INFO [Listener at localhost/45931] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:12,153 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:12,153 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:12,154 INFO [Listener at localhost/45931] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:12,154 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:12,154 INFO [Listener at localhost/45931] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:12,154 INFO [Listener at localhost/45931] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:12,156 INFO [Listener at localhost/45931] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43407 2023-02-15 21:01:12,156 INFO [Listener at localhost/45931] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:12,157 DEBUG [Listener at localhost/45931] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:12,158 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:12,160 INFO [Listener at localhost/45931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:12,163 INFO [Listener at localhost/45931] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43407 connecting to ZooKeeper ensemble=127.0.0.1:51186 2023-02-15 21:01:12,167 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:434070x0, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:12,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43407-0x10059c97fdb0002 connected 2023-02-15 21:01:12,168 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:12,169 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:12,170 DEBUG [Listener at localhost/45931] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:12,170 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43407 2023-02-15 21:01:12,170 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43407 2023-02-15 21:01:12,171 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43407 2023-02-15 21:01:12,171 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43407 2023-02-15 21:01:12,171 DEBUG [Listener at localhost/45931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43407 2023-02-15 21:01:12,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:12,182 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:12,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:12,205 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:12,205 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:12,205 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:12,205 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:12,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:12,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:12,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41737,1676494870941 from backup master directory 2023-02-15 21:01:12,211 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:12,211 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:12,212 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:12,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:12,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-15 21:01:12,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-15 21:01:12,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/hbase.id with ID: d045bb58-b895-4996-803e-20984eb036f6 2023-02-15 21:01:12,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:12,360 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:12,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x67e2f497 to 127.0.0.1:51186 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:12,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@224912b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:12,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:12,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:12,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-15 21:01:12,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-15 21:01:12,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 21:01:12,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-15 21:01:12,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:12,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store-tmp 2023-02-15 21:01:12,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:12,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:12,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:12,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:12,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/WALs/jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:12,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41737%2C1676494870941, suffix=, logDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/WALs/jenkins-hbase4.apache.org,41737,1676494870941, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:12,657 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK] 2023-02-15 21:01:12,657 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK] 2023-02-15 21:01:12,665 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-15 21:01:12,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/WALs/jenkins-hbase4.apache.org,41737,1676494870941/jenkins-hbase4.apache.org%2C41737%2C1676494870941.1676494872610 2023-02-15 21:01:12,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK], DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK]] 2023-02-15 21:01:12,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:12,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:12,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:12,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:12,813 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:12,819 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:12,850 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:12,862 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:12,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:12,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:12,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:12,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:12,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63861422, jitterRate=-0.04839065670967102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:12,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:12,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:12,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:12,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:12,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:12,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-15 21:01:12,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-15 21:01:12,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:12,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:12,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:13,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:13,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:13,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:13,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:13,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:13,034 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:13,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:13,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:13,059 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:13,059 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:13,059 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:13,059 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:13,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41737,1676494870941, sessionid=0x10059c97fdb0000, setting cluster-up flag (Was=false) 2023-02-15 21:01:13,081 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:13,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:13,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:13,102 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:13,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:13,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:13,111 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.hbase-snapshot/.tmp 2023-02-15 21:01:13,175 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(952): ClusterId : d045bb58-b895-4996-803e-20984eb036f6 2023-02-15 21:01:13,175 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(952): ClusterId : d045bb58-b895-4996-803e-20984eb036f6 2023-02-15 21:01:13,181 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:13,181 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:13,189 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:13,189 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:13,189 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:13,189 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:13,193 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:13,193 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:13,195 DEBUG [RS:0;jenkins-hbase4:46537] zookeeper.ReadOnlyZKClient(139): Connect 0x77e20efa to 127.0.0.1:51186 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:13,195 DEBUG [RS:1;jenkins-hbase4:43407] zookeeper.ReadOnlyZKClient(139): Connect 0x193b3a6a to 127.0.0.1:51186 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:13,202 DEBUG [RS:0;jenkins-hbase4:46537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61c95905, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:13,203 DEBUG [RS:1;jenkins-hbase4:43407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d584495, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:13,203 DEBUG [RS:0;jenkins-hbase4:46537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@760bc3ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:13,203 DEBUG [RS:1;jenkins-hbase4:43407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504c691b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:13,231 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43407 2023-02-15 21:01:13,233 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46537 2023-02-15 21:01:13,236 INFO [RS:1;jenkins-hbase4:43407] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:13,237 INFO [RS:0;jenkins-hbase4:46537] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:13,237 INFO [RS:1;jenkins-hbase4:43407] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:13,237 INFO [RS:0;jenkins-hbase4:46537] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:13,237 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:13,237 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:13,241 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41737,1676494870941 with isa=jenkins-hbase4.apache.org/172.31.14.131:46537, startcode=1676494872102 2023-02-15 21:01:13,241 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41737,1676494870941 with isa=jenkins-hbase4.apache.org/172.31.14.131:43407, startcode=1676494872153 2023-02-15 21:01:13,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:13,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:13,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:13,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:13,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:13,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:13,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:13,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494903262 2023-02-15 21:01:13,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:13,266 DEBUG [RS:1;jenkins-hbase4:43407] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:13,266 DEBUG [RS:0;jenkins-hbase4:46537] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:13,267 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:13,268 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:13,273 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:13,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:13,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:13,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:13,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:13,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:13,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:13,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:13,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:13,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:13,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:13,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494873299,5,FailOnTimeoutGroup] 2023-02-15 21:01:13,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494873300,5,FailOnTimeoutGroup] 2023-02-15 21:01:13,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:13,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,321 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:13,323 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:13,323 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b 2023-02-15 21:01:13,335 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37115, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:13,335 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35507, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:13,357 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:13,360 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:13,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41737] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,361 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/info 2023-02-15 21:01:13,365 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:13,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:13,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:13,369 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:13,369 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:13,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:13,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:13,373 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/table 2023-02-15 21:01:13,373 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:13,374 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:13,377 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740 2023-02-15 21:01:13,378 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740 2023-02-15 21:01:13,382 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b 2023-02-15 21:01:13,382 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42563 2023-02-15 21:01:13,382 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b 2023-02-15 21:01:13,382 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:13,382 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42563 2023-02-15 21:01:13,383 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:13,383 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:13,386 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:13,389 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:13,390 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:13,391 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64614518, jitterRate=-0.037168651819229126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:13,392 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:13,392 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:13,392 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:13,392 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:13,392 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:13,392 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:13,393 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:13,394 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:13,394 DEBUG [RS:1;jenkins-hbase4:43407] zookeeper.ZKUtil(162): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,394 WARN [RS:1;jenkins-hbase4:43407] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:13,394 INFO [RS:1;jenkins-hbase4:43407] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:13,395 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,395 DEBUG [RS:0;jenkins-hbase4:46537] zookeeper.ZKUtil(162): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,395 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46537,1676494872102] 2023-02-15 21:01:13,395 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43407,1676494872153] 2023-02-15 21:01:13,395 WARN [RS:0;jenkins-hbase4:46537] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:13,398 INFO [RS:0;jenkins-hbase4:46537] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:13,398 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,401 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:13,402 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:13,408 DEBUG [RS:1;jenkins-hbase4:43407] zookeeper.ZKUtil(162): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,408 DEBUG [RS:0;jenkins-hbase4:46537] zookeeper.ZKUtil(162): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,409 DEBUG [RS:1;jenkins-hbase4:43407] zookeeper.ZKUtil(162): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,409 DEBUG [RS:0;jenkins-hbase4:46537] zookeeper.ZKUtil(162): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:13,421 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:13,421 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:13,425 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:13,428 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:13,433 INFO [RS:1;jenkins-hbase4:43407] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:13,433 INFO [RS:0;jenkins-hbase4:46537] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:13,453 INFO [RS:1;jenkins-hbase4:43407] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:13,453 INFO [RS:0;jenkins-hbase4:46537] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:13,457 INFO [RS:1;jenkins-hbase4:43407] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:13,457 INFO [RS:0;jenkins-hbase4:46537] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:13,458 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,458 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,459 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:13,459 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:13,468 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,468 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,468 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,468 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,469 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:13,469 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:13,469 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:0;jenkins-hbase4:46537] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,470 DEBUG [RS:1;jenkins-hbase4:43407] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:13,471 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,472 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,472 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,472 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,472 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,472 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,491 INFO [RS:1;jenkins-hbase4:43407] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:13,491 INFO [RS:0;jenkins-hbase4:46537] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:13,494 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46537,1676494872102-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,494 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43407,1676494872153-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:13,516 INFO [RS:0;jenkins-hbase4:46537] regionserver.Replication(203): jenkins-hbase4.apache.org,46537,1676494872102 started 2023-02-15 21:01:13,516 INFO [RS:1;jenkins-hbase4:43407] regionserver.Replication(203): jenkins-hbase4.apache.org,43407,1676494872153 started 2023-02-15 21:01:13,516 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46537,1676494872102, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46537, sessionid=0x10059c97fdb0001 2023-02-15 21:01:13,516 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43407,1676494872153, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43407, sessionid=0x10059c97fdb0002 2023-02-15 21:01:13,516 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:13,516 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:13,516 DEBUG [RS:0;jenkins-hbase4:46537] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,517 DEBUG [RS:1;jenkins-hbase4:43407] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,517 DEBUG [RS:0;jenkins-hbase4:46537] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46537,1676494872102' 2023-02-15 21:01:13,517 DEBUG [RS:1;jenkins-hbase4:43407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43407,1676494872153' 2023-02-15 21:01:13,518 DEBUG [RS:0;jenkins-hbase4:46537] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:13,518 DEBUG [RS:1;jenkins-hbase4:43407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:13,519 DEBUG [RS:0;jenkins-hbase4:46537] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:13,519 DEBUG [RS:1;jenkins-hbase4:43407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:13,519 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:13,519 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:13,519 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:13,519 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:13,519 DEBUG [RS:0;jenkins-hbase4:46537] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:13,520 DEBUG [RS:1;jenkins-hbase4:43407] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,520 DEBUG [RS:1;jenkins-hbase4:43407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43407,1676494872153' 2023-02-15 21:01:13,520 DEBUG [RS:1;jenkins-hbase4:43407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:13,520 DEBUG [RS:0;jenkins-hbase4:46537] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46537,1676494872102' 2023-02-15 21:01:13,520 DEBUG [RS:0;jenkins-hbase4:46537] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:13,521 DEBUG [RS:1;jenkins-hbase4:43407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:13,521 DEBUG [RS:0;jenkins-hbase4:46537] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:13,521 DEBUG [RS:1;jenkins-hbase4:43407] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:13,521 DEBUG [RS:0;jenkins-hbase4:46537] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:13,521 INFO [RS:1;jenkins-hbase4:43407] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:13,522 INFO [RS:0;jenkins-hbase4:46537] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:13,522 INFO [RS:1;jenkins-hbase4:43407] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:13,522 INFO [RS:0;jenkins-hbase4:46537] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:13,580 DEBUG [jenkins-hbase4:41737] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:13,584 DEBUG [jenkins-hbase4:41737] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:13,591 DEBUG [jenkins-hbase4:41737] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:13,591 DEBUG [jenkins-hbase4:41737] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:13,591 DEBUG [jenkins-hbase4:41737] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:13,594 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43407,1676494872153, state=OPENING 2023-02-15 21:01:13,602 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:13,603 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:13,604 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:13,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:13,795 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:13,797 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:13,800 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51206, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:13,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:13,812 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:13,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43407%2C1676494872153.meta, suffix=.meta, logDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,43407,1676494872153, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/oldWALs, maxLogs=32 2023-02-15 21:01:13,836 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK] 2023-02-15 21:01:13,837 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK] 2023-02-15 21:01:13,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,43407,1676494872153/jenkins-hbase4.apache.org%2C43407%2C1676494872153.meta.1676494873819.meta 2023-02-15 21:01:13,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK], DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK]] 2023-02-15 21:01:13,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:13,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:13,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:13,873 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:13,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:13,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:13,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:13,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:13,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:13,884 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/info 2023-02-15 21:01:13,884 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/info 2023-02-15 21:01:13,885 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:13,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:13,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:13,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:13,888 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:13,888 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:13,889 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:13,889 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:13,891 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/table 2023-02-15 21:01:13,891 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/table 2023-02-15 21:01:13,892 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:13,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:13,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740 2023-02-15 21:01:13,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740 2023-02-15 21:01:13,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:13,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:13,910 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73489560, jitterRate=0.09507977962493896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:13,911 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:13,924 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494873786 2023-02-15 21:01:13,943 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:13,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:13,945 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43407,1676494872153, state=OPEN 2023-02-15 21:01:13,948 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:13,948 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:13,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:13,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43407,1676494872153 in 340 msec 2023-02-15 21:01:13,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:13,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2023-02-15 21:01:13,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 794 msec 2023-02-15 21:01:13,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494873962, completionTime=-1 2023-02-15 21:01:13,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:13,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:14,028 DEBUG [hconnection-0x6a9e6b49-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:14,030 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:14,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:14,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494934049 2023-02-15 21:01:14,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676494994049 2023-02-15 21:01:14,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 87 msec 2023-02-15 21:01:14,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41737,1676494870941-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:14,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41737,1676494870941-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:14,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41737,1676494870941-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:14,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41737, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:14,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:14,085 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:14,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:14,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:14,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:14,108 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:14,110 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:14,132 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/hbase/namespace/2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,135 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/hbase/namespace/2308ebc89837ac463f07998a2be36099 empty. 2023-02-15 21:01:14,136 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/hbase/namespace/2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,136 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:14,166 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:14,168 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2308ebc89837ac463f07998a2be36099, NAME => 'hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:14,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:14,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 2308ebc89837ac463f07998a2be36099, disabling compactions & flushes 2023-02-15 21:01:14,187 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. after waiting 0 ms 2023-02-15 21:01:14,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,187 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 2308ebc89837ac463f07998a2be36099: 2023-02-15 21:01:14,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:14,207 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494874195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494874195"}]},"ts":"1676494874195"} 2023-02-15 21:01:14,238 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:14,240 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:14,244 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494874240"}]},"ts":"1676494874240"} 2023-02-15 21:01:14,250 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:14,254 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:14,255 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:14,256 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:14,256 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:14,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2308ebc89837ac463f07998a2be36099, ASSIGN}] 2023-02-15 21:01:14,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2308ebc89837ac463f07998a2be36099, ASSIGN 2023-02-15 21:01:14,264 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2308ebc89837ac463f07998a2be36099, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46537,1676494872102; forceNewPlan=false, retain=false 2023-02-15 21:01:14,417 INFO [jenkins-hbase4:41737] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:14,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2308ebc89837ac463f07998a2be36099, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:14,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494874418"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494874418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494874418"}]},"ts":"1676494874418"} 2023-02-15 21:01:14,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2308ebc89837ac463f07998a2be36099, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:14,533 INFO [RS:0;jenkins-hbase4:46537] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46537%2C1676494872102, suffix=, logDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,46537,1676494872102, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/oldWALs, maxLogs=32 2023-02-15 21:01:14,534 INFO [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43407%2C1676494872153, suffix=, logDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,43407,1676494872153, archiveDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/oldWALs, maxLogs=32 2023-02-15 21:01:14,554 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK] 2023-02-15 21:01:14,554 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK] 2023-02-15 21:01:14,556 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK] 2023-02-15 21:01:14,556 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK] 2023-02-15 21:01:14,560 INFO [RS:0;jenkins-hbase4:46537] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,46537,1676494872102/jenkins-hbase4.apache.org%2C46537%2C1676494872102.1676494874536 2023-02-15 21:01:14,561 DEBUG [RS:0;jenkins-hbase4:46537] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK], DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK]] 2023-02-15 21:01:14,562 INFO [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,43407,1676494872153/jenkins-hbase4.apache.org%2C43407%2C1676494872153.1676494874536 2023-02-15 21:01:14,562 DEBUG [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39183,DS-f8ef0ec4-afb9-47bc-9edb-ae8b4b7206db,DISK], DatanodeInfoWithStorage[127.0.0.1:34913,DS-c8973d95-6c83-479e-9bc7-4da43d4d1906,DISK]] 2023-02-15 21:01:14,578 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:14,578 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:14,581 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:14,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2308ebc89837ac463f07998a2be36099, NAME => 'hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:14,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:14,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,595 INFO [StoreOpener-2308ebc89837ac463f07998a2be36099-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,597 DEBUG [StoreOpener-2308ebc89837ac463f07998a2be36099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/info 2023-02-15 21:01:14,597 DEBUG [StoreOpener-2308ebc89837ac463f07998a2be36099-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/info 2023-02-15 21:01:14,598 INFO [StoreOpener-2308ebc89837ac463f07998a2be36099-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2308ebc89837ac463f07998a2be36099 columnFamilyName info 2023-02-15 21:01:14,599 INFO [StoreOpener-2308ebc89837ac463f07998a2be36099-1] regionserver.HStore(310): Store=2308ebc89837ac463f07998a2be36099/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:14,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:14,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:14,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2308ebc89837ac463f07998a2be36099; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61231980, jitterRate=-0.08757239580154419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:14,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2308ebc89837ac463f07998a2be36099: 2023-02-15 21:01:14,612 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099., pid=6, masterSystemTime=1676494874578 2023-02-15 21:01:14,618 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,618 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:14,620 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2308ebc89837ac463f07998a2be36099, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:14,620 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494874619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494874619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494874619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494874619"}]},"ts":"1676494874619"} 2023-02-15 21:01:14,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:14,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2308ebc89837ac463f07998a2be36099, server=jenkins-hbase4.apache.org,46537,1676494872102 in 200 msec 2023-02-15 21:01:14,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:14,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2308ebc89837ac463f07998a2be36099, ASSIGN in 370 msec 2023-02-15 21:01:14,634 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:14,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494874634"}]},"ts":"1676494874634"} 2023-02-15 21:01:14,639 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:14,643 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:14,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2023-02-15 21:01:14,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:14,710 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:14,710 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:14,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:14,739 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38642, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:14,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:14,776 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:14,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-02-15 21:01:14,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:14,801 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:14,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-15 21:01:14,814 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:14,818 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:14,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.606sec 2023-02-15 21:01:14,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:14,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:14,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:14,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41737,1676494870941-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:14,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41737,1676494870941-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:14,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:14,881 DEBUG [Listener at localhost/45931] zookeeper.ReadOnlyZKClient(139): Connect 0x659a4d79 to 127.0.0.1:51186 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:14,885 DEBUG [Listener at localhost/45931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1413088b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:14,926 DEBUG [hconnection-0x1f92f1d8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:14,939 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:14,949 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:14,949 DEBUG [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:14,959 DEBUG [Listener at localhost/45931] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:14,962 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:14,967 INFO [Listener at localhost/45931] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 21:01:14,972 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 21:01:14,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:14,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:55780 deadline: 1676494934970, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 21:01:14,991 INFO [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 21:01:15,007 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:15,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 21:01:15,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:15,015 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:15,049 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 21:01:15,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:15,072 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:15,072 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:15,076 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 empty. 2023-02-15 21:01:15,076 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:15,076 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:15,076 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:15,077 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 empty. 2023-02-15 21:01:15,076 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc empty. 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 empty. 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:15,079 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:15,080 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff empty. 2023-02-15 21:01:15,080 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:15,080 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 empty. 2023-02-15 21:01:15,080 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e empty. 2023-02-15 21:01:15,081 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 empty. 2023-02-15 21:01:15,081 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:15,081 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a empty. 2023-02-15 21:01:15,081 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:15,081 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:15,081 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:15,082 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:15,082 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:15,084 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e empty. 2023-02-15 21:01:15,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:15,085 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 21:01:15,114 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:15,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9d73cb52fd9edf2494d646aaf4ee9ba1, NAME => 'testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f647bdd8e70d71d94c0bff32e3dcf5f5, NAME => 'testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,119 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4d8d18736bb242ed1cd6ddf6f4838087, NAME => 'testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,166 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4d8d18736bb242ed1cd6ddf6f4838087, disabling compactions & flushes 2023-02-15 21:01:15,167 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:15,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:15,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. after waiting 0 ms 2023-02-15 21:01:15,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:15,167 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:15,167 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:15,167 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4e8d8959cfe575eaef8c49ab9114f4dc, NAME => 'testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9d73cb52fd9edf2494d646aaf4ee9ba1, disabling compactions & flushes 2023-02-15 21:01:15,168 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:15,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:15,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. after waiting 0 ms 2023-02-15 21:01:15,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f647bdd8e70d71d94c0bff32e3dcf5f5, disabling compactions & flushes 2023-02-15 21:01:15,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:15,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:15,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:15,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:15,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:15,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. after waiting 0 ms 2023-02-15 21:01:15,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:15,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:15,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:15,170 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41a48046d69ae425294b4db759fbd5ff, NAME => 'testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,170 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2fe7e513432ac3d1fa0bd53ba596cf1e, NAME => 'testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:15,201 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4e8d8959cfe575eaef8c49ab9114f4dc, disabling compactions & flushes 2023-02-15 21:01:15,203 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:15,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:15,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. after waiting 0 ms 2023-02-15 21:01:15,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:15,204 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:15,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:15,205 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3ab1350bfd6de7d89aa6948386a8b02e, NAME => 'testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 2fe7e513432ac3d1fa0bd53ba596cf1e, disabling compactions & flushes 2023-02-15 21:01:15,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:15,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:15,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. after waiting 0 ms 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 41a48046d69ae425294b4db759fbd5ff, disabling compactions & flushes 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:15,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:15,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. after waiting 0 ms 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:15,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:15,207 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:15,208 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0a252bdb931db8c92238de87c150baf0, NAME => 'testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,208 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4180e496656aaf891e03297b96285b4a, NAME => 'testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,232 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,233 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0a252bdb931db8c92238de87c150baf0, disabling compactions & flushes 2023-02-15 21:01:15,233 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:15,233 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:15,233 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. after waiting 0 ms 2023-02-15 21:01:15,233 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:15,233 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:15,233 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:15,234 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d531ab9f1d8a3223cc76c23847a96c2, NAME => 'testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp 2023-02-15 21:01:15,234 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4180e496656aaf891e03297b96285b4a, disabling compactions & flushes 2023-02-15 21:01:15,235 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:15,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:15,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. after waiting 0 ms 2023-02-15 21:01:15,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:15,235 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:15,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:15,251 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4d531ab9f1d8a3223cc76c23847a96c2, disabling compactions & flushes 2023-02-15 21:01:15,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:15,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:15,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. after waiting 0 ms 2023-02-15 21:01:15,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:15,252 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:15,252 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:15,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:15,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:15,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3ab1350bfd6de7d89aa6948386a8b02e, disabling compactions & flushes 2023-02-15 21:01:15,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:15,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:15,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. after waiting 0 ms 2023-02-15 21:01:15,634 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:15,634 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:15,635 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:15,640 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:15,642 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,642 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,642 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494875642"}]},"ts":"1676494875642"} 2023-02-15 21:01:15,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:15,697 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 21:01:15,699 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:15,699 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494875699"}]},"ts":"1676494875699"} 2023-02-15 21:01:15,702 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 21:01:15,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:15,723 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:15,723 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:15,724 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:15,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, ASSIGN}] 2023-02-15 21:01:15,728 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, ASSIGN 2023-02-15 21:01:15,729 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, ASSIGN 2023-02-15 21:01:15,729 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, ASSIGN 2023-02-15 21:01:15,730 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, ASSIGN 2023-02-15 21:01:15,731 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46537,1676494872102; forceNewPlan=false, retain=false 2023-02-15 21:01:15,731 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43407,1676494872153; forceNewPlan=false, retain=false 2023-02-15 21:01:15,731 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43407,1676494872153; forceNewPlan=false, retain=false 2023-02-15 21:01:15,731 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, ASSIGN 2023-02-15 21:01:15,732 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46537,1676494872102; forceNewPlan=false, retain=false 2023-02-15 21:01:15,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, ASSIGN 2023-02-15 21:01:15,732 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, ASSIGN 2023-02-15 21:01:15,733 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, ASSIGN 2023-02-15 21:01:15,734 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43407,1676494872153; forceNewPlan=false, retain=false 2023-02-15 21:01:15,734 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, ASSIGN 2023-02-15 21:01:15,735 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46537,1676494872102; forceNewPlan=false, retain=false 2023-02-15 21:01:15,735 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46537,1676494872102; forceNewPlan=false, retain=false 2023-02-15 21:01:15,735 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43407,1676494872153; forceNewPlan=false, retain=false 2023-02-15 21:01:15,736 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, ASSIGN 2023-02-15 21:01:15,736 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43407,1676494872153; forceNewPlan=false, retain=false 2023-02-15 21:01:15,737 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46537,1676494872102; forceNewPlan=false, retain=false 2023-02-15 21:01:15,881 INFO [jenkins-hbase4:41737] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 21:01:15,884 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=4180e496656aaf891e03297b96285b4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:15,884 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=41a48046d69ae425294b4db759fbd5ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:15,884 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3ab1350bfd6de7d89aa6948386a8b02e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:15,884 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9d73cb52fd9edf2494d646aaf4ee9ba1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:15,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4e8d8959cfe575eaef8c49ab9114f4dc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:15,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875884"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875884"}]},"ts":"1676494875884"} 2023-02-15 21:01:15,885 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494875884"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875884"}]},"ts":"1676494875884"} 2023-02-15 21:01:15,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875884"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875884"}]},"ts":"1676494875884"} 2023-02-15 21:01:15,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875884"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875884"}]},"ts":"1676494875884"} 2023-02-15 21:01:15,885 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875884"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875884"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875884"}]},"ts":"1676494875884"} 2023-02-15 21:01:15,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 4e8d8959cfe575eaef8c49ab9114f4dc, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:15,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure 4180e496656aaf891e03297b96285b4a, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:15,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 9d73cb52fd9edf2494d646aaf4ee9ba1, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:15,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure 3ab1350bfd6de7d89aa6948386a8b02e, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:15,894 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=f647bdd8e70d71d94c0bff32e3dcf5f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:15,895 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875894"}]},"ts":"1676494875894"} 2023-02-15 21:01:15,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 41a48046d69ae425294b4db759fbd5ff, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:15,897 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0a252bdb931db8c92238de87c150baf0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:15,897 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875897"}]},"ts":"1676494875897"} 2023-02-15 21:01:15,898 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d8d18736bb242ed1cd6ddf6f4838087, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:15,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure f647bdd8e70d71d94c0bff32e3dcf5f5, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:15,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875898"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875898"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875898"}]},"ts":"1676494875898"} 2023-02-15 21:01:15,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 0a252bdb931db8c92238de87c150baf0, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:15,902 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4d531ab9f1d8a3223cc76c23847a96c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:15,902 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494875902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875902"}]},"ts":"1676494875902"} 2023-02-15 21:01:15,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 4d8d18736bb242ed1cd6ddf6f4838087, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:15,904 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2fe7e513432ac3d1fa0bd53ba596cf1e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:15,905 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494875904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494875904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494875904"}]},"ts":"1676494875904"} 2023-02-15 21:01:15,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure 4d531ab9f1d8a3223cc76c23847a96c2, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:15,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 2fe7e513432ac3d1fa0bd53ba596cf1e, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:16,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:16,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4180e496656aaf891e03297b96285b4a, NAME => 'testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 21:01:16,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,050 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,053 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1 2023-02-15 21:01:16,053 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1 2023-02-15 21:01:16,053 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4180e496656aaf891e03297b96285b4a columnFamilyName f1 2023-02-15 21:01:16,054 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(310): Store=4180e496656aaf891e03297b96285b4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,055 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:16,059 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2 2023-02-15 21:01:16,059 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2 2023-02-15 21:01:16,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2fe7e513432ac3d1fa0bd53ba596cf1e, NAME => 'testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 21:01:16,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,060 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4180e496656aaf891e03297b96285b4a columnFamilyName f2 2023-02-15 21:01:16,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,060 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(310): Store=4180e496656aaf891e03297b96285b4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,063 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,065 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1 2023-02-15 21:01:16,065 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1 2023-02-15 21:01:16,066 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fe7e513432ac3d1fa0bd53ba596cf1e columnFamilyName f1 2023-02-15 21:01:16,067 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(310): Store=2fe7e513432ac3d1fa0bd53ba596cf1e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,067 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,069 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2 2023-02-15 21:01:16,069 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2 2023-02-15 21:01:16,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:16,070 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fe7e513432ac3d1fa0bd53ba596cf1e columnFamilyName f2 2023-02-15 21:01:16,071 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(310): Store=2fe7e513432ac3d1fa0bd53ba596cf1e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4180e496656aaf891e03297b96285b4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61239552, jitterRate=-0.08745956420898438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:16,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a., pid=22, masterSystemTime=1676494876041 2023-02-15 21:01:16,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:16,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:16,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:16,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e8d8959cfe575eaef8c49ab9114f4dc, NAME => 'testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 21:01:16,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:16,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,080 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=4180e496656aaf891e03297b96285b4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:16,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,080 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876079"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876079"}]},"ts":"1676494876079"} 2023-02-15 21:01:16,082 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,087 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1 2023-02-15 21:01:16,087 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1 2023-02-15 21:01:16,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2fe7e513432ac3d1fa0bd53ba596cf1e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74867720, jitterRate=0.11561596393585205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:16,088 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8d8959cfe575eaef8c49ab9114f4dc columnFamilyName f1 2023-02-15 21:01:16,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-15 21:01:16,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure 4180e496656aaf891e03297b96285b4a, server=jenkins-hbase4.apache.org,46537,1676494872102 in 193 msec 2023-02-15 21:01:16,088 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(310): Store=4e8d8959cfe575eaef8c49ab9114f4dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,089 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e., pid=30, masterSystemTime=1676494876052 2023-02-15 21:01:16,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, ASSIGN in 364 msec 2023-02-15 21:01:16,091 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2 2023-02-15 21:01:16,091 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2 2023-02-15 21:01:16,092 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8d8959cfe575eaef8c49ab9114f4dc columnFamilyName f2 2023-02-15 21:01:16,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:16,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:16,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:16,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d531ab9f1d8a3223cc76c23847a96c2, NAME => 'testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 21:01:16,093 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(310): Store=4e8d8959cfe575eaef8c49ab9114f4dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,094 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2fe7e513432ac3d1fa0bd53ba596cf1e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:16,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,094 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876093"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876093"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876093"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876093"}]},"ts":"1676494876093"} 2023-02-15 21:01:16,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,097 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,099 DEBUG [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f1 2023-02-15 21:01:16,099 DEBUG [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f1 2023-02-15 21:01:16,100 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d531ab9f1d8a3223cc76c23847a96c2 columnFamilyName f1 2023-02-15 21:01:16,101 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(310): Store=4d531ab9f1d8a3223cc76c23847a96c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,102 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:16,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-15 21:01:16,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 2fe7e513432ac3d1fa0bd53ba596cf1e, server=jenkins-hbase4.apache.org,43407,1676494872153 in 188 msec 2023-02-15 21:01:16,106 DEBUG [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f2 2023-02-15 21:01:16,106 DEBUG [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f2 2023-02-15 21:01:16,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, ASSIGN in 379 msec 2023-02-15 21:01:16,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,107 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d531ab9f1d8a3223cc76c23847a96c2 columnFamilyName f2 2023-02-15 21:01:16,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e8d8959cfe575eaef8c49ab9114f4dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72274861, jitterRate=0.07697935402393341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:16,108 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(310): Store=4d531ab9f1d8a3223cc76c23847a96c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc., pid=21, masterSystemTime=1676494876041 2023-02-15 21:01:16,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:16,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:16,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:16,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3ab1350bfd6de7d89aa6948386a8b02e, NAME => 'testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 21:01:16,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,113 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4e8d8959cfe575eaef8c49ab9114f4dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:16,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,114 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876112"}]},"ts":"1676494876112"} 2023-02-15 21:01:16,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,115 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:16,119 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1 2023-02-15 21:01:16,119 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1 2023-02-15 21:01:16,119 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ab1350bfd6de7d89aa6948386a8b02e columnFamilyName f1 2023-02-15 21:01:16,120 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(310): Store=3ab1350bfd6de7d89aa6948386a8b02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,121 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-15 21:01:16,122 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 4e8d8959cfe575eaef8c49ab9114f4dc, server=jenkins-hbase4.apache.org,46537,1676494872102 in 230 msec 2023-02-15 21:01:16,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d531ab9f1d8a3223cc76c23847a96c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58934704, jitterRate=-0.12180447578430176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:16,124 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2 2023-02-15 21:01:16,125 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2 2023-02-15 21:01:16,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, ASSIGN in 398 msec 2023-02-15 21:01:16,125 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ab1350bfd6de7d89aa6948386a8b02e columnFamilyName f2 2023-02-15 21:01:16,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2., pid=29, masterSystemTime=1676494876052 2023-02-15 21:01:16,126 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(310): Store=3ab1350bfd6de7d89aa6948386a8b02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:16,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:16,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:16,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d8d18736bb242ed1cd6ddf6f4838087, NAME => 'testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 21:01:16,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4d531ab9f1d8a3223cc76c23847a96c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:16,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494876130"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876130"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876130"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876130"}]},"ts":"1676494876130"} 2023-02-15 21:01:16,132 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,135 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1 2023-02-15 21:01:16,135 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1 2023-02-15 21:01:16,136 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d8d18736bb242ed1cd6ddf6f4838087 columnFamilyName f1 2023-02-15 21:01:16,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:16,137 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(310): Store=4d8d18736bb242ed1cd6ddf6f4838087/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,137 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-15 21:01:16,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure 4d531ab9f1d8a3223cc76c23847a96c2, server=jenkins-hbase4.apache.org,43407,1676494872153 in 225 msec 2023-02-15 21:01:16,140 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2 2023-02-15 21:01:16,140 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2 2023-02-15 21:01:16,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, ASSIGN in 414 msec 2023-02-15 21:01:16,141 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d8d18736bb242ed1cd6ddf6f4838087 columnFamilyName f2 2023-02-15 21:01:16,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,142 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(310): Store=4d8d18736bb242ed1cd6ddf6f4838087/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3ab1350bfd6de7d89aa6948386a8b02e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71422316, jitterRate=0.06427544355392456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:16,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e., pid=24, masterSystemTime=1676494876041 2023-02-15 21:01:16,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:16,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:16,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:16,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9d73cb52fd9edf2494d646aaf4ee9ba1, NAME => 'testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 21:01:16,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,148 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3ab1350bfd6de7d89aa6948386a8b02e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:16,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876148"}]},"ts":"1676494876148"} 2023-02-15 21:01:16,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,149 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,152 DEBUG [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f1 2023-02-15 21:01:16,152 DEBUG [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f1 2023-02-15 21:01:16,152 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d73cb52fd9edf2494d646aaf4ee9ba1 columnFamilyName f1 2023-02-15 21:01:16,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:16,153 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(310): Store=9d73cb52fd9edf2494d646aaf4ee9ba1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,155 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-15 21:01:16,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure 3ab1350bfd6de7d89aa6948386a8b02e, server=jenkins-hbase4.apache.org,46537,1676494872102 in 259 msec 2023-02-15 21:01:16,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,159 DEBUG [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f2 2023-02-15 21:01:16,159 DEBUG [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f2 2023-02-15 21:01:16,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d8d18736bb242ed1cd6ddf6f4838087; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66147844, jitterRate=-0.014320313930511475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:16,159 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d73cb52fd9edf2494d646aaf4ee9ba1 columnFamilyName f2 2023-02-15 21:01:16,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, ASSIGN in 434 msec 2023-02-15 21:01:16,160 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(310): Store=9d73cb52fd9edf2494d646aaf4ee9ba1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087., pid=28, masterSystemTime=1676494876052 2023-02-15 21:01:16,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:16,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:16,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:16,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0a252bdb931db8c92238de87c150baf0, NAME => 'testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 21:01:16,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,167 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4d8d18736bb242ed1cd6ddf6f4838087, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:16,167 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876167"}]},"ts":"1676494876167"} 2023-02-15 21:01:16,169 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:16,172 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1 2023-02-15 21:01:16,172 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1 2023-02-15 21:01:16,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9d73cb52fd9edf2494d646aaf4ee9ba1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69591078, jitterRate=0.036987870931625366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:16,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1., pid=23, masterSystemTime=1676494876041 2023-02-15 21:01:16,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-15 21:01:16,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 4d8d18736bb242ed1cd6ddf6f4838087, server=jenkins-hbase4.apache.org,43407,1676494872153 in 267 msec 2023-02-15 21:01:16,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:16,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:16,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:16,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41a48046d69ae425294b4db759fbd5ff, NAME => 'testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 21:01:16,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, ASSIGN in 450 msec 2023-02-15 21:01:16,179 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9d73cb52fd9edf2494d646aaf4ee9ba1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:16,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494876179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876179"}]},"ts":"1676494876179"} 2023-02-15 21:01:16,181 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:16,183 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1 2023-02-15 21:01:16,183 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1 2023-02-15 21:01:16,184 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41a48046d69ae425294b4db759fbd5ff columnFamilyName f1 2023-02-15 21:01:16,185 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(310): Store=41a48046d69ae425294b4db759fbd5ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,185 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-15 21:01:16,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 9d73cb52fd9edf2494d646aaf4ee9ba1, server=jenkins-hbase4.apache.org,46537,1676494872102 in 291 msec 2023-02-15 21:01:16,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, ASSIGN in 461 msec 2023-02-15 21:01:16,188 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a252bdb931db8c92238de87c150baf0 columnFamilyName f1 2023-02-15 21:01:16,189 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(310): Store=0a252bdb931db8c92238de87c150baf0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,189 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,189 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2 2023-02-15 21:01:16,190 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2 2023-02-15 21:01:16,190 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41a48046d69ae425294b4db759fbd5ff columnFamilyName f2 2023-02-15 21:01:16,191 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(310): Store=41a48046d69ae425294b4db759fbd5ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,191 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2 2023-02-15 21:01:16,191 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2 2023-02-15 21:01:16,192 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a252bdb931db8c92238de87c150baf0 columnFamilyName f2 2023-02-15 21:01:16,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,193 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(310): Store=0a252bdb931db8c92238de87c150baf0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:16,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:16,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41a48046d69ae425294b4db759fbd5ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73816292, jitterRate=0.0999484658241272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:16,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff., pid=25, masterSystemTime=1676494876041 2023-02-15 21:01:16,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0a252bdb931db8c92238de87c150baf0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63639582, jitterRate=-0.051696330308914185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:16,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0., pid=27, masterSystemTime=1676494876052 2023-02-15 21:01:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:16,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:16,208 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=41a48046d69ae425294b4db759fbd5ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:16,209 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876208"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876208"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876208"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876208"}]},"ts":"1676494876208"} 2023-02-15 21:01:16,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:16,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:16,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:16,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f647bdd8e70d71d94c0bff32e3dcf5f5, NAME => 'testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 21:01:16,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:16,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,211 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0a252bdb931db8c92238de87c150baf0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:16,211 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876211"}]},"ts":"1676494876211"} 2023-02-15 21:01:16,213 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-15 21:01:16,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 41a48046d69ae425294b4db759fbd5ff, server=jenkins-hbase4.apache.org,46537,1676494872102 in 315 msec 2023-02-15 21:01:16,217 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1 2023-02-15 21:01:16,217 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1 2023-02-15 21:01:16,217 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f647bdd8e70d71d94c0bff32e3dcf5f5 columnFamilyName f1 2023-02-15 21:01:16,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, ASSIGN in 492 msec 2023-02-15 21:01:16,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-15 21:01:16,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 0a252bdb931db8c92238de87c150baf0, server=jenkins-hbase4.apache.org,43407,1676494872153 in 313 msec 2023-02-15 21:01:16,219 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(310): Store=f647bdd8e70d71d94c0bff32e3dcf5f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,220 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, ASSIGN in 495 msec 2023-02-15 21:01:16,222 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2 2023-02-15 21:01:16,222 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2 2023-02-15 21:01:16,222 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f647bdd8e70d71d94c0bff32e3dcf5f5 columnFamilyName f2 2023-02-15 21:01:16,223 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(310): Store=f647bdd8e70d71d94c0bff32e3dcf5f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:16,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:16,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:16,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:16,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f647bdd8e70d71d94c0bff32e3dcf5f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67496714, jitterRate=0.0057794153690338135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:16,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:16,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5., pid=26, masterSystemTime=1676494876052 2023-02-15 21:01:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:16,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:16,238 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=f647bdd8e70d71d94c0bff32e3dcf5f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:16,238 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494876237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494876237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494876237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494876237"}]},"ts":"1676494876237"} 2023-02-15 21:01:16,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-15 21:01:16,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure f647bdd8e70d71d94c0bff32e3dcf5f5, server=jenkins-hbase4.apache.org,43407,1676494872153 in 341 msec 2023-02-15 21:01:16,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-15 21:01:16,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, ASSIGN in 519 msec 2023-02-15 21:01:16,248 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:16,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494876248"}]},"ts":"1676494876248"} 2023-02-15 21:01:16,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 21:01:16,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:16,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2460 sec 2023-02-15 21:01:17,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:17,188 INFO [Listener at localhost/45931] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 21:01:17,188 DEBUG [Listener at localhost/45931] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 21:01:17,190 INFO [Listener at localhost/45931] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:17,204 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 21:01:17,205 INFO [Listener at localhost/45931] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:17,205 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 21:01:17,205 INFO [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:17,358 DEBUG [hconnection-0x1f92f1d8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:17,446 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:17,491 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43407] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:17,493 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46537] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:17,816 INFO [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:17,820 INFO [Listener at localhost/45931] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:17,835 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494877835 (current time:1676494877835). 2023-02-15 21:01:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] zookeeper.ReadOnlyZKClient(139): Connect 0x181a0f18 to 127.0.0.1:51186 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:17,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61ca5f8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:17,855 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x181a0f18 to 127.0.0.1:51186 2023-02-15 21:01:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:17,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:17,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:17,887 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:17,888 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676495477888 2023-02-15 21:01:17,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:17,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 21:01:17,891 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:17,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:17,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 15 msec 2023-02-15 21:01:17,893 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:17,894 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676495477894 2023-02-15 21:01:17,895 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:17,895 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:17,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-15 21:01:17,932 INFO [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-15 21:01:17,932 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:17,933 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-15 21:01:17,933 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 21:01:17,934 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:17,934 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:17,936 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:17,936 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:17,936 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:17,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:17,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:17,938 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,938 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:17,939 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,939 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:17,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:17,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 21:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-15 21:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:17,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 21:01:17,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 21:01:17,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 21:01:17,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-15 21:01:17,944 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 21:01:17,944 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 21:01:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-15 21:01:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 21:01:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46537,1676494872102' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 21:01:17,953 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 21:01:17,953 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-15 21:01:17,953 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43407,1676494872153' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-15 21:01:17,955 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,955 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:17,956 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,956 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:17,956 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,956 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:17,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:17,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43407,1676494872153' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 21:01:17,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1390339e[Count = 1] remaining members to acquire global barrier 2023-02-15 21:01:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:17,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:17,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46537,1676494872102' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-15 21:01:17,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1390339e[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:17,963 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 21:01:17,963 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:17,965 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:17,965 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:17,965 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:17,966 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:17,966 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:17,968 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:17,968 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:17,968 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:17,969 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. started... 2023-02-15 21:01:17,969 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. started... 2023-02-15 21:01:17,969 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:17,969 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. started... 2023-02-15 21:01:17,969 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 21:01:17,969 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:17,969 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:17,970 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. started... 2023-02-15 21:01:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 21:01:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:17,970 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. started... 2023-02-15 21:01:17,970 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:17,971 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. started... 2023-02-15 21:01:17,973 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f647bdd8e70d71d94c0bff32e3dcf5f5 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 21:01:17,975 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3ab1350bfd6de7d89aa6948386a8b02e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:17,975 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:17,976 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4e8d8959cfe575eaef8c49ab9114f4dc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:17,977 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:17,982 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:17,983 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0a252bdb931db8c92238de87c150baf0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 21:01:17,984 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4180e496656aaf891e03297b96285b4a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:17,988 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:17,988 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:17,995 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:17,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:18,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:18,005 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:18,013 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. completed. 2023-02-15 21:01:18,013 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:18,016 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:18,016 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 21:01:18,016 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. started... 2023-02-15 21:01:18,017 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2fe7e513432ac3d1fa0bd53ba596cf1e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:18,200 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f1/77d64a7593a6451a94e66c302767c6dd 2023-02-15 21:01:18,205 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:18,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:18,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:18,210 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f1/dcf0ac2d8797404780999199131a60d5 2023-02-15 21:01:18,210 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 21:01:18,223 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f1/27023cef9c8d482e85e9d20852977994 2023-02-15 21:01:18,238 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f1/a7431bb397fe4dec8a63bc56d6e3674e 2023-02-15 21:01:18,248 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f1/915ab20ac40d40468c0a1c0f47ebf767 2023-02-15 21:01:18,269 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f1/ee2c171a0193442f86f57672a2871940 2023-02-15 21:01:18,385 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f2/60b41a03acab4d2badab68b795abb3b2 2023-02-15 21:01:18,422 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f2/8119cb762e524bcc868f7036d31de240 2023-02-15 21:01:18,430 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f2/2d792a071f264ffdb42a01bd9dc3bd45 2023-02-15 21:01:18,430 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f2/a37b833df874440d948c0e1503d8eef3 2023-02-15 21:01:18,431 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f2/27612645741e4cba88a7f2346606f54a 2023-02-15 21:01:18,431 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f2/6e6e1e97ed994302b2581bde8fc73cd3 2023-02-15 21:01:18,437 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f1/915ab20ac40d40468c0a1c0f47ebf767 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/915ab20ac40d40468c0a1c0f47ebf767 2023-02-15 21:01:18,446 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f1/dcf0ac2d8797404780999199131a60d5 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/dcf0ac2d8797404780999199131a60d5 2023-02-15 21:01:18,449 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f1/27023cef9c8d482e85e9d20852977994 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/27023cef9c8d482e85e9d20852977994 2023-02-15 21:01:18,449 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f1/a7431bb397fe4dec8a63bc56d6e3674e as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a7431bb397fe4dec8a63bc56d6e3674e 2023-02-15 21:01:18,450 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f1/77d64a7593a6451a94e66c302767c6dd as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/77d64a7593a6451a94e66c302767c6dd 2023-02-15 21:01:18,453 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f1/ee2c171a0193442f86f57672a2871940 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/ee2c171a0193442f86f57672a2871940 2023-02-15 21:01:18,454 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/915ab20ac40d40468c0a1c0f47ebf767, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,457 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f2/60b41a03acab4d2badab68b795abb3b2 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/60b41a03acab4d2badab68b795abb3b2 2023-02-15 21:01:18,462 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/dcf0ac2d8797404780999199131a60d5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,466 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f2/8119cb762e524bcc868f7036d31de240 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/8119cb762e524bcc868f7036d31de240 2023-02-15 21:01:18,468 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a7431bb397fe4dec8a63bc56d6e3674e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,469 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/27023cef9c8d482e85e9d20852977994, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:18,471 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f2/6e6e1e97ed994302b2581bde8fc73cd3 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/6e6e1e97ed994302b2581bde8fc73cd3 2023-02-15 21:01:18,471 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f2/27612645741e4cba88a7f2346606f54a as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/27612645741e4cba88a7f2346606f54a 2023-02-15 21:01:18,471 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/ee2c171a0193442f86f57672a2871940, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,473 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/77d64a7593a6451a94e66c302767c6dd, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:18,474 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f2/a37b833df874440d948c0e1503d8eef3 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/a37b833df874440d948c0e1503d8eef3 2023-02-15 21:01:18,476 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f2/2d792a071f264ffdb42a01bd9dc3bd45 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/2d792a071f264ffdb42a01bd9dc3bd45 2023-02-15 21:01:18,481 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/8119cb762e524bcc868f7036d31de240, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,483 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4180e496656aaf891e03297b96285b4a in 499ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,485 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 21:01:18,486 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/60b41a03acab4d2badab68b795abb3b2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,487 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4e8d8959cfe575eaef8c49ab9114f4dc in 511ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,487 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 21:01:18,487 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:18,483 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/27612645741e4cba88a7f2346606f54a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:18,488 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:18,489 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,489 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,490 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/915ab20ac40d40468c0a1c0f47ebf767] hfiles 2023-02-15 21:01:18,490 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/915ab20ac40d40468c0a1c0f47ebf767 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,490 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 0a252bdb931db8c92238de87c150baf0 in 507ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,490 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/27023cef9c8d482e85e9d20852977994] hfiles 2023-02-15 21:01:18,491 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/a37b833df874440d948c0e1503d8eef3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,491 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/27023cef9c8d482e85e9d20852977994 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,491 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/6e6e1e97ed994302b2581bde8fc73cd3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,492 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3ab1350bfd6de7d89aa6948386a8b02e in 518ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,492 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:18,492 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,492 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,493 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/ee2c171a0193442f86f57672a2871940] hfiles 2023-02-15 21:01:18,493 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/ee2c171a0193442f86f57672a2871940 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,493 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/2d792a071f264ffdb42a01bd9dc3bd45, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:18,494 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2fe7e513432ac3d1fa0bd53ba596cf1e in 476ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a7431bb397fe4dec8a63bc56d6e3674e] hfiles 2023-02-15 21:01:18,494 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for f647bdd8e70d71d94c0bff32e3dcf5f5 in 521ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a7431bb397fe4dec8a63bc56d6e3674e for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/27612645741e4cba88a7f2346606f54a] hfiles 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/60b41a03acab4d2badab68b795abb3b2] hfiles 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/a37b833df874440d948c0e1503d8eef3] hfiles 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/6e6e1e97ed994302b2581bde8fc73cd3] hfiles 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/6e6e1e97ed994302b2581bde8fc73cd3 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/77d64a7593a6451a94e66c302767c6dd] hfiles 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/a37b833df874440d948c0e1503d8eef3 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/60b41a03acab4d2badab68b795abb3b2 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,494 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/27612645741e4cba88a7f2346606f54a for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/dcf0ac2d8797404780999199131a60d5] hfiles 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/77d64a7593a6451a94e66c302767c6dd for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/dcf0ac2d8797404780999199131a60d5 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,495 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/2d792a071f264ffdb42a01bd9dc3bd45] hfiles 2023-02-15 21:01:18,496 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/8119cb762e524bcc868f7036d31de240] hfiles 2023-02-15 21:01:18,496 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/2d792a071f264ffdb42a01bd9dc3bd45 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,496 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/8119cb762e524bcc868f7036d31de240 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,510 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:18,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:18,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:18,512 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 21:01:18,541 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. completed. 2023-02-15 21:01:18,541 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:18,541 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:18,541 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 21:01:18,541 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. started... 2023-02-15 21:01:18,542 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 41a48046d69ae425294b4db759fbd5ff 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:18,544 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. completed. 2023-02-15 21:01:18,544 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:18,544 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:18,544 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. started... 2023-02-15 21:01:18,544 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. completed. 2023-02-15 21:01:18,544 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 21:01:18,544 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:18,546 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:18,546 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 21:01:18,546 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,546 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,546 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:18,546 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:18,563 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. completed. 2023-02-15 21:01:18,563 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:18,563 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:18,563 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 21:01:18,563 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. started... 2023-02-15 21:01:18,564 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4d8d18736bb242ed1cd6ddf6f4838087 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:18,565 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. completed. 2023-02-15 21:01:18,565 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:18,565 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 21:01:18,565 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. completed. 2023-02-15 21:01:18,565 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:18,565 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 21:01:18,605 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. completed. 2023-02-15 21:01:18,606 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:18,606 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 21:01:18,612 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f1/41bf9938dd654108855699f7e773946a 2023-02-15 21:01:18,616 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f1/20871a5772fa4ea2b969649d00b35c68 2023-02-15 21:01:18,648 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f2/2ab6da6d13db4257b1532c8b45d97eb4 2023-02-15 21:01:18,653 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f2/c5709c6d4d3a49b398bac7e58ee9582b 2023-02-15 21:01:18,666 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f1/41bf9938dd654108855699f7e773946a as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/41bf9938dd654108855699f7e773946a 2023-02-15 21:01:18,674 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f1/20871a5772fa4ea2b969649d00b35c68 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/20871a5772fa4ea2b969649d00b35c68 2023-02-15 21:01:18,678 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/41bf9938dd654108855699f7e773946a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,680 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f2/2ab6da6d13db4257b1532c8b45d97eb4 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/2ab6da6d13db4257b1532c8b45d97eb4 2023-02-15 21:01:18,686 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/20871a5772fa4ea2b969649d00b35c68, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,688 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f2/c5709c6d4d3a49b398bac7e58ee9582b as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/c5709c6d4d3a49b398bac7e58ee9582b 2023-02-15 21:01:18,694 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/2ab6da6d13db4257b1532c8b45d97eb4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,696 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 41a48046d69ae425294b4db759fbd5ff in 154ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,696 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:18,696 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,697 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,697 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/41bf9938dd654108855699f7e773946a] hfiles 2023-02-15 21:01:18,697 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/41bf9938dd654108855699f7e773946a for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,697 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/2ab6da6d13db4257b1532c8b45d97eb4] hfiles 2023-02-15 21:01:18,697 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/2ab6da6d13db4257b1532c8b45d97eb4 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,700 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/c5709c6d4d3a49b398bac7e58ee9582b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:18,702 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4d8d18736bb242ed1cd6ddf6f4838087 in 138ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/20871a5772fa4ea2b969649d00b35c68] hfiles 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/20871a5772fa4ea2b969649d00b35c68 for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/c5709c6d4d3a49b398bac7e58ee9582b] hfiles 2023-02-15 21:01:18,702 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/c5709c6d4d3a49b398bac7e58ee9582b for snapshot=testWithMapReduceMultiRegion 2023-02-15 21:01:18,757 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. completed. 2023-02-15 21:01:18,757 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,757 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. completed. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43407,1676494872153' in zk 2023-02-15 21:01:18,757 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 21:01:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,758 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-15 21:01:18,758 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46537,1676494872102' in zk 2023-02-15 21:01:18,762 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 21:01:18,762 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:18,762 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 21:01:18,762 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,763 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-15 21:01:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,763 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:18,763 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-15 21:01:18,763 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46537,1676494872102': 2023-02-15 21:01:18,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46537,1676494872102' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 21:01:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:18,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43407,1676494872153': 2023-02-15 21:01:18,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43407,1676494872153' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:18,777 INFO [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-15 21:01:18,778 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:18,778 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:18,778 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-15 21:01:18,778 INFO [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:18,781 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,781 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:18,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,781 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,781 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:18,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,782 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:18,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:18,784 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,785 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:18,787 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-15 21:01:18,788 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,806 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:18,806 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:18,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:18,806 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,807 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:18,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-15 21:01:18,807 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:18,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:18,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-15 21:01:18,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:18,806 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:18,806 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:18,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:18,807 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:18,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:18,808 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-15 21:01:18,808 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:18,808 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:18,808 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:18,808 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-15 21:01:18,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:18,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:18,808 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-15 21:01:18,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 21:01:18,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-15 21:01:18,925 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-15 21:01:18,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 21:01:18,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-15 21:01:18,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676494877889Consolidate snapshot: testWithMapReduceMultiRegion at 1676494878807 (+918 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676494878808 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676494878831 (+23 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676494878847 (+16 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676494878925 (+78 ms) 2023-02-15 21:01:18,928 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:18,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0380 sec 2023-02-15 21:01:19,012 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:19,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:19,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:19,014 INFO [Listener at localhost/45931] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:19,029 INFO [Listener at localhost/45931] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:19,041 INFO [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:19,098 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46537] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:19,108 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43407] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:19,225 INFO [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:19,241 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:19,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 21:01:19,248 INFO [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 21:01:19,248 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:19,249 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 21:01:19,249 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 21:01:19,250 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,250 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,251 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:19,251 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:19,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:19,251 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:19,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:19,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:19,252 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,252 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,253 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,253 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:19,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:19,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 21:01:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 21:01:19,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 21:01:19,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 21:01:19,256 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 21:01:19,256 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:19,260 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 21:01:19,260 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 21:01:19,260 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:19,261 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 21:01:19,262 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:19,262 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:19,262 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. started... 2023-02-15 21:01:19,262 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. started... 2023-02-15 21:01:19,262 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:19,262 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. started... 2023-02-15 21:01:19,262 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f647bdd8e70d71d94c0bff32e3dcf5f5 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 21:01:19,262 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3ab1350bfd6de7d89aa6948386a8b02e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:19,262 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e8d8959cfe575eaef8c49ab9114f4dc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:19,263 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:19,263 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. started... 2023-02-15 21:01:19,263 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:19,263 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:19,263 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 21:01:19,263 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:19,264 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:19,264 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:19,264 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:19,264 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 21:01:19,267 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:19,267 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. started... 2023-02-15 21:01:19,267 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 21:01:19,264 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. started... 2023-02-15 21:01:19,264 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. started... 2023-02-15 21:01:19,268 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0a252bdb931db8c92238de87c150baf0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 21:01:19,268 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4180e496656aaf891e03297b96285b4a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:19,268 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2fe7e513432ac3d1fa0bd53ba596cf1e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:19,340 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f1/1471b02a38734bc4be9decdcb117cd18 2023-02-15 21:01:19,356 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f1/31539920e281418f88f0218d2f44e80e 2023-02-15 21:01:19,367 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f1/e95917427afc43da90b4f3fd9576d81f 2023-02-15 21:01:19,373 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f2/3c43c62307d3469aabac406a3a9f63be 2023-02-15 21:01:19,381 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f2/adae02ef667c425c86c433a7a5e4cac1 2023-02-15 21:01:19,382 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f1/1471b02a38734bc4be9decdcb117cd18 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/1471b02a38734bc4be9decdcb117cd18 2023-02-15 21:01:19,388 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f1/31539920e281418f88f0218d2f44e80e as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/31539920e281418f88f0218d2f44e80e 2023-02-15 21:01:19,391 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/1471b02a38734bc4be9decdcb117cd18, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,392 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f2/8af7301278fb49aa85e888e567ee3fad 2023-02-15 21:01:19,393 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/.tmp/f2/3c43c62307d3469aabac406a3a9f63be as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/3c43c62307d3469aabac406a3a9f63be 2023-02-15 21:01:19,399 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f1/e95917427afc43da90b4f3fd9576d81f as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/e95917427afc43da90b4f3fd9576d81f 2023-02-15 21:01:19,403 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/31539920e281418f88f0218d2f44e80e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,404 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/.tmp/f2/adae02ef667c425c86c433a7a5e4cac1 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/adae02ef667c425c86c433a7a5e4cac1 2023-02-15 21:01:19,405 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/e95917427afc43da90b4f3fd9576d81f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:19,407 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/3c43c62307d3469aabac406a3a9f63be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,407 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/.tmp/f2/8af7301278fb49aa85e888e567ee3fad as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/8af7301278fb49aa85e888e567ee3fad 2023-02-15 21:01:19,408 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3ab1350bfd6de7d89aa6948386a8b02e in 146ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,408 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:19,409 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:19,409 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:19,409 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 21:01:19,409 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. started... 2023-02-15 21:01:19,409 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 41a48046d69ae425294b4db759fbd5ff 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:19,413 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/adae02ef667c425c86c433a7a5e4cac1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,415 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4180e496656aaf891e03297b96285b4a in 147ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,415 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-15 21:01:19,415 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:19,415 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:19,415 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 21:01:19,415 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:19,415 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. started... 2023-02-15 21:01:19,415 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:19,416 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:19,416 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 21:01:19,416 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/8af7301278fb49aa85e888e567ee3fad, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:19,417 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for f647bdd8e70d71d94c0bff32e3dcf5f5 in 155ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,417 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:19,417 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:19,418 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:19,418 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 21:01:19,418 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. started... 2023-02-15 21:01:19,418 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4d8d18736bb242ed1cd6ddf6f4838087 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:19,432 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f1/5dd4d1caf8cf4842a2cb7f49f4bb9c29 2023-02-15 21:01:19,473 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f1/726042b1fffa475d94bb452fd5b2910c 2023-02-15 21:01:19,496 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f2/9cb4c73bda87462da5cefe4624b68433 2023-02-15 21:01:19,505 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f1/5dd4d1caf8cf4842a2cb7f49f4bb9c29 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/5dd4d1caf8cf4842a2cb7f49f4bb9c29 2023-02-15 21:01:19,514 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/5dd4d1caf8cf4842a2cb7f49f4bb9c29, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,516 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/.tmp/f2/9cb4c73bda87462da5cefe4624b68433 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/9cb4c73bda87462da5cefe4624b68433 2023-02-15 21:01:19,519 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 21:01:19,521 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 21:01:19,524 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f2/eec45586606d4fff889bc40ce3ee347f 2023-02-15 21:01:19,525 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/9cb4c73bda87462da5cefe4624b68433, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,526 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 41a48046d69ae425294b4db759fbd5ff in 117ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,527 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:19,527 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:19,527 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 21:01:19,533 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f1/726042b1fffa475d94bb452fd5b2910c as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/726042b1fffa475d94bb452fd5b2910c 2023-02-15 21:01:19,540 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/726042b1fffa475d94bb452fd5b2910c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,541 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/.tmp/f2/eec45586606d4fff889bc40ce3ee347f as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/eec45586606d4fff889bc40ce3ee347f 2023-02-15 21:01:19,547 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/eec45586606d4fff889bc40ce3ee347f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,548 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4d8d18736bb242ed1cd6ddf6f4838087 in 130ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,548 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:19,548 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:19,548 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 21:01:19,745 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f1/be1406cddddd4e0eaed6197aa13da607 2023-02-15 21:01:19,751 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f1/a41f798eeea5414494b4527badecc812 2023-02-15 21:01:19,752 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f1/8a80c3b616ac4d3abeeba93e113483c2 2023-02-15 21:01:19,784 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f2/80ace24fe41c4432adf7bd2340602a3b 2023-02-15 21:01:19,784 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f2/384b630dac01439a90898264440ed156 2023-02-15 21:01:19,787 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f2/c9abf07dbfc44919851cc7b05fcbf861 2023-02-15 21:01:19,791 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f1/a41f798eeea5414494b4527badecc812 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a41f798eeea5414494b4527badecc812 2023-02-15 21:01:19,795 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f1/8a80c3b616ac4d3abeeba93e113483c2 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/8a80c3b616ac4d3abeeba93e113483c2 2023-02-15 21:01:19,798 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f1/be1406cddddd4e0eaed6197aa13da607 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/be1406cddddd4e0eaed6197aa13da607 2023-02-15 21:01:19,799 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a41f798eeea5414494b4527badecc812, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,800 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/.tmp/f2/384b630dac01439a90898264440ed156 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/384b630dac01439a90898264440ed156 2023-02-15 21:01:19,803 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/8a80c3b616ac4d3abeeba93e113483c2, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:19,804 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/be1406cddddd4e0eaed6197aa13da607, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,805 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/.tmp/f2/c9abf07dbfc44919851cc7b05fcbf861 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/c9abf07dbfc44919851cc7b05fcbf861 2023-02-15 21:01:19,805 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/.tmp/f2/80ace24fe41c4432adf7bd2340602a3b as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/80ace24fe41c4432adf7bd2340602a3b 2023-02-15 21:01:19,807 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/384b630dac01439a90898264440ed156, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,809 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2fe7e513432ac3d1fa0bd53ba596cf1e in 541ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,809 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:19,809 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:19,809 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 21:01:19,812 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/c9abf07dbfc44919851cc7b05fcbf861, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:19,812 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/80ace24fe41c4432adf7bd2340602a3b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:19,813 INFO [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 0a252bdb931db8c92238de87c150baf0 in 546ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,813 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:19,813 DEBUG [rs(jenkins-hbase4.apache.org,43407,1676494872153)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:19,813 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 21:01:19,813 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 21:01:19,813 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,813 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 21:01:19,813 INFO [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4e8d8959cfe575eaef8c49ab9114f4dc in 551ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:19,813 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43407,1676494872153' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 21:01:19,813 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:19,814 DEBUG [rs(jenkins-hbase4.apache.org,46537,1676494872102)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:19,814 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 21:01:19,814 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 21:01:19,814 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,814 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 21:01:19,814 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46537,1676494872102' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 21:01:19,816 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,816 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:19,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:19,818 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,818 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:19,818 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,819 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:19,819 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,819 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:19,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:19,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43407,1676494872153' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 21:01:19,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f986324[Count = 1] remaining members to acquire global barrier 2023-02-15 21:01:19,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:19,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:19,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:19,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46537,1676494872102' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 21:01:19,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f986324[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:19,824 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 21:01:19,824 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 21:01:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 21:01:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 21:01:19,826 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43407,1676494872153' in zk 2023-02-15 21:01:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 21:01:19,826 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46537,1676494872102' in zk 2023-02-15 21:01:19,827 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,827 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:19,828 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 21:01:19,828 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,828 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:19,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:19,829 DEBUG [member: 'jenkins-hbase4.apache.org,43407,1676494872153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 21:01:19,829 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 21:01:19,829 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:19,829 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,829 DEBUG [member: 'jenkins-hbase4.apache.org,46537,1676494872102' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 21:01:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:19,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43407,1676494872153': 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43407,1676494872153' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:19,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46537,1676494872102': 2023-02-15 21:01:19,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46537,1676494872102' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 21:01:19,841 INFO [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 21:01:19,841 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:19,841 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:19,841 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 21:01:19,841 INFO [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:19,845 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,845 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,845 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,845 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:19,845 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:19,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:19,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:19,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:19,846 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,847 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,849 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,849 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:19,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:19,855 DEBUG [(jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:19,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:19,855 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 21:01:19,856 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:01:19,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:19,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:19,855 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:19,856 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:19,858 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,858 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:19,858 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:19,858 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:19,858 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:19,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:19,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:19,858 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:01:19,959 DEBUG [Listener at localhost/45931] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:01:19,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:01:20,062 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop-6607769943899530018.jar 2023-02-15 21:01:20,078 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676494877835 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:20,079 DEBUG [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce 2023-02-15 21:01:20,080 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:20,080 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:20,080 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:20,080 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(239): region to add: 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=f647bdd8e70d71d94c0bff32e3dcf5f5 as f647bdd8e70d71d94c0bff32e3dcf5f5 in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=4d531ab9f1d8a3223cc76c23847a96c2 as 4d531ab9f1d8a3223cc76c23847a96c2 in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=0a252bdb931db8c92238de87c150baf0 as 0a252bdb931db8c92238de87c150baf0 in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=3ab1350bfd6de7d89aa6948386a8b02e as 3ab1350bfd6de7d89aa6948386a8b02e in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=4e8d8959cfe575eaef8c49ab9114f4dc as 4e8d8959cfe575eaef8c49ab9114f4dc in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,081 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=4180e496656aaf891e03297b96285b4a as 4180e496656aaf891e03297b96285b4a in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,082 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=41a48046d69ae425294b4db759fbd5ff as 41a48046d69ae425294b4db759fbd5ff in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,082 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=2fe7e513432ac3d1fa0bd53ba596cf1e as 2fe7e513432ac3d1fa0bd53ba596cf1e in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,082 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=9d73cb52fd9edf2494d646aaf4ee9ba1 as 9d73cb52fd9edf2494d646aaf4ee9ba1 in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,082 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(585): clone region=4d8d18736bb242ed1cd6ddf6f4838087 as 4d8d18736bb242ed1cd6ddf6f4838087 in snapshot testWithMapReduceMultiRegion 2023-02-15 21:01:20,085 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f647bdd8e70d71d94c0bff32e3dcf5f5, NAME => 'testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,085 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3ab1350bfd6de7d89aa6948386a8b02e, NAME => 'testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,085 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0a252bdb931db8c92238de87c150baf0, NAME => 'testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,085 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4d531ab9f1d8a3223cc76c23847a96c2, NAME => 'testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,086 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2fe7e513432ac3d1fa0bd53ba596cf1e, NAME => 'testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,086 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 41a48046d69ae425294b4db759fbd5ff, NAME => 'testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,086 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4180e496656aaf891e03297b96285b4a, NAME => 'testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,087 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4e8d8959cfe575eaef8c49ab9114f4dc, NAME => 'testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,119 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,119 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,119 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 77d64a7593a6451a94e66c302767c6dd from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,119 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 4d531ab9f1d8a3223cc76c23847a96c2, disabling compactions & flushes 2023-02-15 21:01:20,120 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:20,120 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:20,120 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. after waiting 0 ms 2023-02-15 21:01:20,120 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:20,120 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:20,120 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:20,121 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9d73cb52fd9edf2494d646aaf4ee9ba1, NAME => 'testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,126 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,126 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27023cef9c8d482e85e9d20852977994 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,136 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2d792a071f264ffdb42a01bd9dc3bd45 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,136 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,136 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41bf9938dd654108855699f7e773946a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,138 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,138 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27612645741e4cba88a7f2346606f54a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,138 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dcf0ac2d8797404780999199131a60d5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,148 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ab6da6d13db4257b1532c8b45d97eb4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,148 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f647bdd8e70d71d94c0bff32e3dcf5f5, disabling compactions & flushes 2023-02-15 21:01:20,148 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:20,149 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:20,149 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. after waiting 0 ms 2023-02-15 21:01:20,149 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:20,149 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:20,149 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:20,150 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d8d18736bb242ed1cd6ddf6f4838087, NAME => 'testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,150 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 0a252bdb931db8c92238de87c150baf0, disabling compactions & flushes 2023-02-15 21:01:20,150 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,150 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:20,151 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 915ab20ac40d40468c0a1c0f47ebf767 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,151 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:20,151 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. after waiting 0 ms 2023-02-15 21:01:20,151 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:20,151 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:20,151 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:20,151 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8119cb762e524bcc868f7036d31de240 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 41a48046d69ae425294b4db759fbd5ff, disabling compactions & flushes 2023-02-15 21:01:20,155 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60b41a03acab4d2badab68b795abb3b2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,155 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. after waiting 0 ms 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4180e496656aaf891e03297b96285b4a, disabling compactions & flushes 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:20,155 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:20,155 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. after waiting 0 ms 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:20,155 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:20,155 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:20,157 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4e8d8959cfe575eaef8c49ab9114f4dc, disabling compactions & flushes 2023-02-15 21:01:20,157 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:20,157 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:20,157 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. after waiting 0 ms 2023-02-15 21:01:20,157 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:20,157 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:20,157 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:20,160 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,160 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20871a5772fa4ea2b969649d00b35c68 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,162 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c5709c6d4d3a49b398bac7e58ee9582b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,164 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4d8d18736bb242ed1cd6ddf6f4838087, disabling compactions & flushes 2023-02-15 21:01:20,164 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:20,164 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:20,164 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. after waiting 0 ms 2023-02-15 21:01:20,164 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:20,164 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:20,164 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:20,512 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,512 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a7431bb397fe4dec8a63bc56d6e3674e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,515 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6e6e1e97ed994302b2581bde8fc73cd3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,518 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2fe7e513432ac3d1fa0bd53ba596cf1e, disabling compactions & flushes 2023-02-15 21:01:20,518 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:20,518 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:20,518 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. after waiting 0 ms 2023-02-15 21:01:20,518 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:20,518 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:20,518 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:20,543 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,543 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee2c171a0193442f86f57672a2871940 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,545 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a37b833df874440d948c0e1503d8eef3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-15 21:01:20,548 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3ab1350bfd6de7d89aa6948386a8b02e, disabling compactions & flushes 2023-02-15 21:01:20,548 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:20,548 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:20,548 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. after waiting 0 ms 2023-02-15 21:01:20,548 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:20,548 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:20,548 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:20,549 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:20,550 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 9d73cb52fd9edf2494d646aaf4ee9ba1, disabling compactions & flushes 2023-02-15 21:01:20,550 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:20,550 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:20,550 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. after waiting 0 ms 2023-02-15 21:01:20,550 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:20,550 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:20,550 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:20,550 INFO [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676494877835 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:20,550 DEBUG [Listener at localhost/45931] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,551 DEBUG [Listener at localhost/45931] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823 2023-02-15 21:01:20,551 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-data/ 2023-02-15 21:01:20,552 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----default/ 2023-02-15 21:01:20,552 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 21:01:20,553 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------0a252bdb931db8c92238de87c150baf0/ 2023-02-15 21:01:20,553 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,553 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,554 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=0a252bdb931db8c92238de87c150baf0-27023cef9c8d482e85e9d20852977994 2023-02-15 21:01:20,554 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,554 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=0a252bdb931db8c92238de87c150baf0-27612645741e4cba88a7f2346606f54a 2023-02-15 21:01:20,554 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------2fe7e513432ac3d1fa0bd53ba596cf1e/ 2023-02-15 21:01:20,555 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,555 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,555 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=2fe7e513432ac3d1fa0bd53ba596cf1e-a7431bb397fe4dec8a63bc56d6e3674e 2023-02-15 21:01:20,555 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,556 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=2fe7e513432ac3d1fa0bd53ba596cf1e-6e6e1e97ed994302b2581bde8fc73cd3 2023-02-15 21:01:20,556 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------3ab1350bfd6de7d89aa6948386a8b02e/ 2023-02-15 21:01:20,556 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,556 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,557 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=3ab1350bfd6de7d89aa6948386a8b02e-ee2c171a0193442f86f57672a2871940 2023-02-15 21:01:20,557 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,557 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=3ab1350bfd6de7d89aa6948386a8b02e-a37b833df874440d948c0e1503d8eef3 2023-02-15 21:01:20,557 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------4180e496656aaf891e03297b96285b4a/ 2023-02-15 21:01:20,558 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,558 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,558 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=4180e496656aaf891e03297b96285b4a-dcf0ac2d8797404780999199131a60d5 2023-02-15 21:01:20,558 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,559 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=4180e496656aaf891e03297b96285b4a-8119cb762e524bcc868f7036d31de240 2023-02-15 21:01:20,559 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------41a48046d69ae425294b4db759fbd5ff/ 2023-02-15 21:01:20,559 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,559 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,560 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=41a48046d69ae425294b4db759fbd5ff-41bf9938dd654108855699f7e773946a 2023-02-15 21:01:20,560 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,560 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=41a48046d69ae425294b4db759fbd5ff-2ab6da6d13db4257b1532c8b45d97eb4 2023-02-15 21:01:20,560 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------4d531ab9f1d8a3223cc76c23847a96c2/ 2023-02-15 21:01:20,561 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,561 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------4d8d18736bb242ed1cd6ddf6f4838087/ 2023-02-15 21:01:20,562 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,562 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,562 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=4d8d18736bb242ed1cd6ddf6f4838087-20871a5772fa4ea2b969649d00b35c68 2023-02-15 21:01:20,562 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,563 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=4d8d18736bb242ed1cd6ddf6f4838087-c5709c6d4d3a49b398bac7e58ee9582b 2023-02-15 21:01:20,563 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------4e8d8959cfe575eaef8c49ab9114f4dc/ 2023-02-15 21:01:20,563 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,563 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,564 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=4e8d8959cfe575eaef8c49ab9114f4dc-915ab20ac40d40468c0a1c0f47ebf767 2023-02-15 21:01:20,564 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,565 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=4e8d8959cfe575eaef8c49ab9114f4dc-60b41a03acab4d2badab68b795abb3b2 2023-02-15 21:01:20,565 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------9d73cb52fd9edf2494d646aaf4ee9ba1/ 2023-02-15 21:01:20,565 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,565 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |----------f647bdd8e70d71d94c0bff32e3dcf5f5/ 2023-02-15 21:01:20,566 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:20,566 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:20,566 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=f647bdd8e70d71d94c0bff32e3dcf5f5-77d64a7593a6451a94e66c302767c6dd 2023-02-15 21:01:20,566 DEBUG [Listener at localhost/45931] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:20,567 DEBUG [Listener at localhost/45931] util.CommonFSUtils(702): |----------------testWithMapReduce=f647bdd8e70d71d94c0bff32e3dcf5f5-2d792a071f264ffdb42a01bd9dc3bd45 2023-02-15 21:01:20,575 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,575 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,576 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,576 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,577 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,577 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,577 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,648 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop-1032269824526129032.jar 2023-02-15 21:01:20,648 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,649 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,649 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,650 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,650 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,651 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,651 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 21:01:20,652 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 21:01:20,652 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 21:01:20,653 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 21:01:20,653 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 21:01:20,654 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 21:01:20,654 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 21:01:20,654 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 21:01:20,655 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 21:01:20,655 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 21:01:20,661 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:20,661 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:01:20,662 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:01:20,662 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:01:20,663 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 21:01:20,731 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop-8246864097974232391.jar 2023-02-15 21:01:20,732 DEBUG [Listener at localhost/45931] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 21:01:20,813 WARN [Listener at localhost/45931] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 21:01:20,876 INFO [Listener at localhost/45931] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 21:01:21,108 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:21,108 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-15 21:01:21,255 WARN [Listener at localhost/45931] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/mapreduce.cluster.local.dir/1676494881155/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 21:01:21,255 WARN [Listener at localhost/45931] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/mapreduce.cluster.local.dir/1676494881155/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 21:01:21,401 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:21,402 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:21,404 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:21,406 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:21,408 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1 2023-02-15 21:01:21,409 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a252bdb931db8c92238de87c150baf0 columnFamilyName f1 2023-02-15 21:01:21,418 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/testWithMapReduce=0a252bdb931db8c92238de87c150baf0-27023cef9c8d482e85e9d20852977994 2023-02-15 21:01:21,419 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(310): Store=0a252bdb931db8c92238de87c150baf0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,419 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:21,420 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2 2023-02-15 21:01:21,421 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a252bdb931db8c92238de87c150baf0 columnFamilyName f2 2023-02-15 21:01:21,428 DEBUG [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/testWithMapReduce=0a252bdb931db8c92238de87c150baf0-27612645741e4cba88a7f2346606f54a 2023-02-15 21:01:21,429 INFO [StoreOpener-0a252bdb931db8c92238de87c150baf0-1] regionserver.HStore(310): Store=0a252bdb931db8c92238de87c150baf0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:21,429 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0a252bdb931db8c92238de87c150baf0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68313063, jitterRate=0.017943963408470154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:21,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:21,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0a252bdb931db8c92238de87c150baf0, disabling compactions & flushes 2023-02-15 21:01:21,583 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:21,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:21,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. after waiting 0 ms 2023-02-15 21:01:21,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:21,587 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:21,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:21,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:21,603 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:21,605 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:21,609 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:21,610 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1 2023-02-15 21:01:21,611 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4180e496656aaf891e03297b96285b4a columnFamilyName f1 2023-02-15 21:01:21,618 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/testWithMapReduce=4180e496656aaf891e03297b96285b4a-dcf0ac2d8797404780999199131a60d5 2023-02-15 21:01:21,618 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(310): Store=4180e496656aaf891e03297b96285b4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,619 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:21,620 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2 2023-02-15 21:01:21,620 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4180e496656aaf891e03297b96285b4a columnFamilyName f2 2023-02-15 21:01:21,626 DEBUG [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/testWithMapReduce=4180e496656aaf891e03297b96285b4a-8119cb762e524bcc868f7036d31de240 2023-02-15 21:01:21,626 INFO [StoreOpener-4180e496656aaf891e03297b96285b4a-1] regionserver.HStore(310): Store=4180e496656aaf891e03297b96285b4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:21,627 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4180e496656aaf891e03297b96285b4a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64575124, jitterRate=-0.03775566816329956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:21,627 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:21,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4180e496656aaf891e03297b96285b4a, disabling compactions & flushes 2023-02-15 21:01:21,674 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:21,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:21,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. after waiting 0 ms 2023-02-15 21:01:21,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:21,681 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:21,681 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:21,687 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:21,688 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:21,689 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:21,691 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:21,693 DEBUG [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f1 2023-02-15 21:01:21,694 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d531ab9f1d8a3223cc76c23847a96c2 columnFamilyName f1 2023-02-15 21:01:21,694 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(310): Store=4d531ab9f1d8a3223cc76c23847a96c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,695 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:21,696 DEBUG [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f2 2023-02-15 21:01:21,697 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d531ab9f1d8a3223cc76c23847a96c2 columnFamilyName f2 2023-02-15 21:01:21,697 INFO [StoreOpener-4d531ab9f1d8a3223cc76c23847a96c2-1] regionserver.HStore(310): Store=4d531ab9f1d8a3223cc76c23847a96c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:21,698 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4d531ab9f1d8a3223cc76c23847a96c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59747086, jitterRate=-0.10969904065132141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:21,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:21,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4d531ab9f1d8a3223cc76c23847a96c2, disabling compactions & flushes 2023-02-15 21:01:21,720 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:21,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:21,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. after waiting 0 ms 2023-02-15 21:01:21,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:21,721 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:21,721 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:21,727 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:21,727 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:21,728 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:21,732 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:21,733 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1 2023-02-15 21:01:21,734 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fe7e513432ac3d1fa0bd53ba596cf1e columnFamilyName f1 2023-02-15 21:01:21,740 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/testWithMapReduce=2fe7e513432ac3d1fa0bd53ba596cf1e-a7431bb397fe4dec8a63bc56d6e3674e 2023-02-15 21:01:21,741 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(310): Store=2fe7e513432ac3d1fa0bd53ba596cf1e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,741 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:21,742 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2 2023-02-15 21:01:21,742 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fe7e513432ac3d1fa0bd53ba596cf1e columnFamilyName f2 2023-02-15 21:01:21,749 DEBUG [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/testWithMapReduce=2fe7e513432ac3d1fa0bd53ba596cf1e-6e6e1e97ed994302b2581bde8fc73cd3 2023-02-15 21:01:21,749 INFO [StoreOpener-2fe7e513432ac3d1fa0bd53ba596cf1e-1] regionserver.HStore(310): Store=2fe7e513432ac3d1fa0bd53ba596cf1e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,750 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:21,750 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2fe7e513432ac3d1fa0bd53ba596cf1e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60602720, jitterRate=-0.09694910049438477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:21,750 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:21,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2fe7e513432ac3d1fa0bd53ba596cf1e, disabling compactions & flushes 2023-02-15 21:01:21,818 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:21,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:21,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. after waiting 0 ms 2023-02-15 21:01:21,818 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:21,821 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:21,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:21,826 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:21,826 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:21,828 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:21,831 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:21,832 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1 2023-02-15 21:01:21,833 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ab1350bfd6de7d89aa6948386a8b02e columnFamilyName f1 2023-02-15 21:01:21,841 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/testWithMapReduce=3ab1350bfd6de7d89aa6948386a8b02e-ee2c171a0193442f86f57672a2871940 2023-02-15 21:01:21,841 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(310): Store=3ab1350bfd6de7d89aa6948386a8b02e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,842 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:21,843 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2 2023-02-15 21:01:21,843 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ab1350bfd6de7d89aa6948386a8b02e columnFamilyName f2 2023-02-15 21:01:21,854 DEBUG [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/testWithMapReduce=3ab1350bfd6de7d89aa6948386a8b02e-a37b833df874440d948c0e1503d8eef3 2023-02-15 21:01:21,854 INFO [StoreOpener-3ab1350bfd6de7d89aa6948386a8b02e-1] regionserver.HStore(310): Store=3ab1350bfd6de7d89aa6948386a8b02e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,854 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:21,854 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3ab1350bfd6de7d89aa6948386a8b02e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74878105, jitterRate=0.11577071249485016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:21,854 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:21,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3ab1350bfd6de7d89aa6948386a8b02e, disabling compactions & flushes 2023-02-15 21:01:21,911 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:21,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:21,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. after waiting 0 ms 2023-02-15 21:01:21,911 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:21,916 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:21,916 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:21,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:21,923 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:21,926 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:21,929 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:21,933 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1 2023-02-15 21:01:21,933 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8d8959cfe575eaef8c49ab9114f4dc columnFamilyName f1 2023-02-15 21:01:21,942 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/testWithMapReduce=4e8d8959cfe575eaef8c49ab9114f4dc-915ab20ac40d40468c0a1c0f47ebf767 2023-02-15 21:01:21,942 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(310): Store=4e8d8959cfe575eaef8c49ab9114f4dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,942 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:21,943 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2 2023-02-15 21:01:21,944 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8d8959cfe575eaef8c49ab9114f4dc columnFamilyName f2 2023-02-15 21:01:21,954 DEBUG [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/testWithMapReduce=4e8d8959cfe575eaef8c49ab9114f4dc-60b41a03acab4d2badab68b795abb3b2 2023-02-15 21:01:21,954 INFO [StoreOpener-4e8d8959cfe575eaef8c49ab9114f4dc-1] regionserver.HStore(310): Store=4e8d8959cfe575eaef8c49ab9114f4dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:21,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:21,955 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4e8d8959cfe575eaef8c49ab9114f4dc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71398323, jitterRate=0.06391791999340057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:21,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:22,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4e8d8959cfe575eaef8c49ab9114f4dc, disabling compactions & flushes 2023-02-15 21:01:22,008 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:22,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:22,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. after waiting 0 ms 2023-02-15 21:01:22,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:22,012 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:22,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:22,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:22,017 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:22,019 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:22,021 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:22,022 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1 2023-02-15 21:01:22,022 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f647bdd8e70d71d94c0bff32e3dcf5f5 columnFamilyName f1 2023-02-15 21:01:22,029 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/testWithMapReduce=f647bdd8e70d71d94c0bff32e3dcf5f5-77d64a7593a6451a94e66c302767c6dd 2023-02-15 21:01:22,029 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(310): Store=f647bdd8e70d71d94c0bff32e3dcf5f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,030 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:22,031 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2 2023-02-15 21:01:22,031 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f647bdd8e70d71d94c0bff32e3dcf5f5 columnFamilyName f2 2023-02-15 21:01:22,037 DEBUG [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/testWithMapReduce=f647bdd8e70d71d94c0bff32e3dcf5f5-2d792a071f264ffdb42a01bd9dc3bd45 2023-02-15 21:01:22,037 INFO [StoreOpener-f647bdd8e70d71d94c0bff32e3dcf5f5-1] regionserver.HStore(310): Store=f647bdd8e70d71d94c0bff32e3dcf5f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:22,038 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f647bdd8e70d71d94c0bff32e3dcf5f5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63421524, jitterRate=-0.05494564771652222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:22,038 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:22,078 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f647bdd8e70d71d94c0bff32e3dcf5f5, disabling compactions & flushes 2023-02-15 21:01:22,078 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:22,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:22,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. after waiting 0 ms 2023-02-15 21:01:22,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:22,082 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:22,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:22,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:22,086 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:22,088 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:22,092 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:22,094 DEBUG [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f1 2023-02-15 21:01:22,094 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d73cb52fd9edf2494d646aaf4ee9ba1 columnFamilyName f1 2023-02-15 21:01:22,095 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(310): Store=9d73cb52fd9edf2494d646aaf4ee9ba1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,095 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:22,096 DEBUG [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f2 2023-02-15 21:01:22,097 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d73cb52fd9edf2494d646aaf4ee9ba1 columnFamilyName f2 2023-02-15 21:01:22,097 INFO [StoreOpener-9d73cb52fd9edf2494d646aaf4ee9ba1-1] regionserver.HStore(310): Store=9d73cb52fd9edf2494d646aaf4ee9ba1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:22,097 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9d73cb52fd9edf2494d646aaf4ee9ba1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66347556, jitterRate=-0.011344373226165771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:22,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:22,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9d73cb52fd9edf2494d646aaf4ee9ba1, disabling compactions & flushes 2023-02-15 21:01:22,138 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:22,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:22,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. after waiting 0 ms 2023-02-15 21:01:22,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:22,139 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:22,139 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:22,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:22,146 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:22,148 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:22,150 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:22,152 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1 2023-02-15 21:01:22,152 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d8d18736bb242ed1cd6ddf6f4838087 columnFamilyName f1 2023-02-15 21:01:22,161 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/testWithMapReduce=4d8d18736bb242ed1cd6ddf6f4838087-20871a5772fa4ea2b969649d00b35c68 2023-02-15 21:01:22,162 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(310): Store=4d8d18736bb242ed1cd6ddf6f4838087/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,162 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:22,163 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2 2023-02-15 21:01:22,163 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d8d18736bb242ed1cd6ddf6f4838087 columnFamilyName f2 2023-02-15 21:01:22,169 DEBUG [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/testWithMapReduce=4d8d18736bb242ed1cd6ddf6f4838087-c5709c6d4d3a49b398bac7e58ee9582b 2023-02-15 21:01:22,169 INFO [StoreOpener-4d8d18736bb242ed1cd6ddf6f4838087-1] regionserver.HStore(310): Store=4d8d18736bb242ed1cd6ddf6f4838087/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:22,170 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4d8d18736bb242ed1cd6ddf6f4838087; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59170613, jitterRate=-0.11828915774822235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:22,170 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:22,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4d8d18736bb242ed1cd6ddf6f4838087, disabling compactions & flushes 2023-02-15 21:01:22,204 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:22,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:22,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. after waiting 0 ms 2023-02-15 21:01:22,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:22,215 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:22,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:22,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:22,222 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:22,233 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:22,241 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:22,242 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1 2023-02-15 21:01:22,242 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41a48046d69ae425294b4db759fbd5ff columnFamilyName f1 2023-02-15 21:01:22,249 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/testWithMapReduce=41a48046d69ae425294b4db759fbd5ff-41bf9938dd654108855699f7e773946a 2023-02-15 21:01:22,250 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(310): Store=41a48046d69ae425294b4db759fbd5ff/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,250 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:22,251 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2 2023-02-15 21:01:22,251 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41a48046d69ae425294b4db759fbd5ff columnFamilyName f2 2023-02-15 21:01:22,257 DEBUG [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(539): loaded hdfs://localhost:42563/user/jenkins/test-data/09f20610-bb79-0544-2549-8717cce315ab/testWithMapReduceMultiRegion/70bc83bf-def9-4bf7-901e-70307b004823/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/testWithMapReduce=41a48046d69ae425294b4db759fbd5ff-2ab6da6d13db4257b1532c8b45d97eb4 2023-02-15 21:01:22,257 INFO [StoreOpener-41a48046d69ae425294b4db759fbd5ff-1] regionserver.HStore(310): Store=41a48046d69ae425294b4db759fbd5ff/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:22,257 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:22,258 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 41a48046d69ae425294b4db759fbd5ff; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65405263, jitterRate=-0.02538563311100006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:22,258 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:22,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 41a48046d69ae425294b4db759fbd5ff, disabling compactions & flushes 2023-02-15 21:01:22,288 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:22,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:22,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. after waiting 0 ms 2023-02-15 21:01:22,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:22,295 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:22,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:23,333 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-15 21:01:23,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-15 21:01:23,340 INFO [Listener at localhost/45931] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 21:01:23,341 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 21:01:23,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 21:01:23,352 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494883352"}]},"ts":"1676494883352"} 2023-02-15 21:01:23,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:23,355 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 21:01:23,357 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 21:01:23,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, UNASSIGN}] 2023-02-15 21:01:23,363 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, UNASSIGN 2023-02-15 21:01:23,363 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, UNASSIGN 2023-02-15 21:01:23,364 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, UNASSIGN 2023-02-15 21:01:23,364 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, UNASSIGN 2023-02-15 21:01:23,364 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, UNASSIGN 2023-02-15 21:01:23,365 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=0a252bdb931db8c92238de87c150baf0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:23,365 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883364"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883364"}]},"ts":"1676494883364"} 2023-02-15 21:01:23,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=4180e496656aaf891e03297b96285b4a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:23,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4d531ab9f1d8a3223cc76c23847a96c2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:23,365 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2fe7e513432ac3d1fa0bd53ba596cf1e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:23,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883365"}]},"ts":"1676494883365"} 2023-02-15 21:01:23,365 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883365"}]},"ts":"1676494883365"} 2023-02-15 21:01:23,365 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3ab1350bfd6de7d89aa6948386a8b02e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:23,365 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494883365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883365"}]},"ts":"1676494883365"} 2023-02-15 21:01:23,366 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883365"}]},"ts":"1676494883365"} 2023-02-15 21:01:23,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure 0a252bdb931db8c92238de87c150baf0, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:23,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure 4180e496656aaf891e03297b96285b4a, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:23,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 2fe7e513432ac3d1fa0bd53ba596cf1e, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:23,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 4d531ab9f1d8a3223cc76c23847a96c2, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:23,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=40, state=RUNNABLE; CloseRegionProcedure 3ab1350bfd6de7d89aa6948386a8b02e, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:23,380 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, UNASSIGN 2023-02-15 21:01:23,381 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=41a48046d69ae425294b4db759fbd5ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:23,381 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883381"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883381"}]},"ts":"1676494883381"} 2023-02-15 21:01:23,382 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, UNASSIGN 2023-02-15 21:01:23,383 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, UNASSIGN 2023-02-15 21:01:23,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4e8d8959cfe575eaef8c49ab9114f4dc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:23,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 41a48046d69ae425294b4db759fbd5ff, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:23,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883385"}]},"ts":"1676494883385"} 2023-02-15 21:01:23,386 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, UNASSIGN 2023-02-15 21:01:23,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4d8d18736bb242ed1cd6ddf6f4838087, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:23,386 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, UNASSIGN 2023-02-15 21:01:23,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883386"}]},"ts":"1676494883386"} 2023-02-15 21:01:23,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f647bdd8e70d71d94c0bff32e3dcf5f5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:23,387 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9d73cb52fd9edf2494d646aaf4ee9ba1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:23,388 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494883387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883387"}]},"ts":"1676494883387"} 2023-02-15 21:01:23,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 4e8d8959cfe575eaef8c49ab9114f4dc, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:23,389 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494883387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494883387"}]},"ts":"1676494883387"} 2023-02-15 21:01:23,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 4d8d18736bb242ed1cd6ddf6f4838087, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:23,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure 9d73cb52fd9edf2494d646aaf4ee9ba1, server=jenkins-hbase4.apache.org,46537,1676494872102}] 2023-02-15 21:01:23,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=35, state=RUNNABLE; CloseRegionProcedure f647bdd8e70d71d94c0bff32e3dcf5f5, server=jenkins-hbase4.apache.org,43407,1676494872153}] 2023-02-15 21:01:23,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:23,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:23,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0a252bdb931db8c92238de87c150baf0, disabling compactions & flushes 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9d73cb52fd9edf2494d646aaf4ee9ba1, disabling compactions & flushes 2023-02-15 21:01:23,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:23,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. after waiting 0 ms 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. after waiting 0 ms 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:23,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:23,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 21:01:23,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1. 2023-02-15 21:01:23,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0. 2023-02-15 21:01:23,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0a252bdb931db8c92238de87c150baf0: 2023-02-15 21:01:23,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9d73cb52fd9edf2494d646aaf4ee9ba1: 2023-02-15 21:01:23,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:23,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:23,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3ab1350bfd6de7d89aa6948386a8b02e, disabling compactions & flushes 2023-02-15 21:01:23,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:23,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:23,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. after waiting 0 ms 2023-02-15 21:01:23,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:23,555 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=9d73cb52fd9edf2494d646aaf4ee9ba1, regionState=CLOSED 2023-02-15 21:01:23,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494883555"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883555"}]},"ts":"1676494883555"} 2023-02-15 21:01:23,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:23,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:23,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d8d18736bb242ed1cd6ddf6f4838087, disabling compactions & flushes 2023-02-15 21:01:23,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:23,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:23,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. after waiting 0 ms 2023-02-15 21:01:23,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:23,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=0a252bdb931db8c92238de87c150baf0, regionState=CLOSED 2023-02-15 21:01:23,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883561"}]},"ts":"1676494883561"} 2023-02-15 21:01:23,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-15 21:01:23,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure 9d73cb52fd9edf2494d646aaf4ee9ba1, server=jenkins-hbase4.apache.org,46537,1676494872102 in 172 msec 2023-02-15 21:01:23,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-15 21:01:23,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure 0a252bdb931db8c92238de87c150baf0, server=jenkins-hbase4.apache.org,43407,1676494872153 in 202 msec 2023-02-15 21:01:23,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d73cb52fd9edf2494d646aaf4ee9ba1, UNASSIGN in 212 msec 2023-02-15 21:01:23,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0a252bdb931db8c92238de87c150baf0, UNASSIGN in 211 msec 2023-02-15 21:01:23,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e. 2023-02-15 21:01:23,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3ab1350bfd6de7d89aa6948386a8b02e: 2023-02-15 21:01:23,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087. 2023-02-15 21:01:23,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d8d18736bb242ed1cd6ddf6f4838087: 2023-02-15 21:01:23,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:23,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:23,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4180e496656aaf891e03297b96285b4a, disabling compactions & flushes 2023-02-15 21:01:23,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:23,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:23,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. after waiting 0 ms 2023-02-15 21:01:23,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:23,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3ab1350bfd6de7d89aa6948386a8b02e, regionState=CLOSED 2023-02-15 21:01:23,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883597"}]},"ts":"1676494883597"} 2023-02-15 21:01:23,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:23,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:23,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d531ab9f1d8a3223cc76c23847a96c2, disabling compactions & flushes 2023-02-15 21:01:23,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:23,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:23,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. after waiting 0 ms 2023-02-15 21:01:23,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:23,598 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4d8d18736bb242ed1cd6ddf6f4838087, regionState=CLOSED 2023-02-15 21:01:23,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883598"}]},"ts":"1676494883598"} 2023-02-15 21:01:23,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=40 2023-02-15 21:01:23,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=40, state=SUCCESS; CloseRegionProcedure 3ab1350bfd6de7d89aa6948386a8b02e, server=jenkins-hbase4.apache.org,46537,1676494872102 in 220 msec 2023-02-15 21:01:23,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-15 21:01:23,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 4d8d18736bb242ed1cd6ddf6f4838087, server=jenkins-hbase4.apache.org,43407,1676494872153 in 210 msec 2023-02-15 21:01:23,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3ab1350bfd6de7d89aa6948386a8b02e, UNASSIGN in 243 msec 2023-02-15 21:01:23,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d8d18736bb242ed1cd6ddf6f4838087, UNASSIGN in 244 msec 2023-02-15 21:01:23,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 21:01:23,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2. 2023-02-15 21:01:23,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d531ab9f1d8a3223cc76c23847a96c2: 2023-02-15 21:01:23,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:23,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:23,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f647bdd8e70d71d94c0bff32e3dcf5f5, disabling compactions & flushes 2023-02-15 21:01:23,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:23,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:23,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. after waiting 0 ms 2023-02-15 21:01:23,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:23,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4d531ab9f1d8a3223cc76c23847a96c2, regionState=CLOSED 2023-02-15 21:01:23,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494883645"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883645"}]},"ts":"1676494883645"} 2023-02-15 21:01:23,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a. 2023-02-15 21:01:23,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4180e496656aaf891e03297b96285b4a: 2023-02-15 21:01:23,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:23,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:23,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41a48046d69ae425294b4db759fbd5ff, disabling compactions & flushes 2023-02-15 21:01:23,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:23,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:23,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. after waiting 0 ms 2023-02-15 21:01:23,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:23,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=4180e496656aaf891e03297b96285b4a, regionState=CLOSED 2023-02-15 21:01:23,653 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883653"}]},"ts":"1676494883653"} 2023-02-15 21:01:23,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-15 21:01:23,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 4d531ab9f1d8a3223cc76c23847a96c2, server=jenkins-hbase4.apache.org,43407,1676494872153 in 273 msec 2023-02-15 21:01:23,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4d531ab9f1d8a3223cc76c23847a96c2, UNASSIGN in 293 msec 2023-02-15 21:01:23,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:23,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-15 21:01:23,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure 4180e496656aaf891e03297b96285b4a, server=jenkins-hbase4.apache.org,46537,1676494872102 in 279 msec 2023-02-15 21:01:23,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4180e496656aaf891e03297b96285b4a, UNASSIGN in 299 msec 2023-02-15 21:01:23,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5. 2023-02-15 21:01:23,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f647bdd8e70d71d94c0bff32e3dcf5f5: 2023-02-15 21:01:23,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff. 2023-02-15 21:01:23,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41a48046d69ae425294b4db759fbd5ff: 2023-02-15 21:01:23,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:23,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:23,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2fe7e513432ac3d1fa0bd53ba596cf1e, disabling compactions & flushes 2023-02-15 21:01:23,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:23,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:23,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=f647bdd8e70d71d94c0bff32e3dcf5f5, regionState=CLOSED 2023-02-15 21:01:23,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. after waiting 0 ms 2023-02-15 21:01:23,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:23,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883689"}]},"ts":"1676494883689"} 2023-02-15 21:01:23,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:23,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:23,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e8d8959cfe575eaef8c49ab9114f4dc, disabling compactions & flushes 2023-02-15 21:01:23,691 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=41a48046d69ae425294b4db759fbd5ff, regionState=CLOSED 2023-02-15 21:01:23,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:23,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:23,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. after waiting 0 ms 2023-02-15 21:01:23,691 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883691"}]},"ts":"1676494883691"} 2023-02-15 21:01:23,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:23,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=35 2023-02-15 21:01:23,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=35, state=SUCCESS; CloseRegionProcedure f647bdd8e70d71d94c0bff32e3dcf5f5, server=jenkins-hbase4.apache.org,43407,1676494872153 in 298 msec 2023-02-15 21:01:23,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-15 21:01:23,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 41a48046d69ae425294b4db759fbd5ff, server=jenkins-hbase4.apache.org,46537,1676494872102 in 308 msec 2023-02-15 21:01:23,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f647bdd8e70d71d94c0bff32e3dcf5f5, UNASSIGN in 336 msec 2023-02-15 21:01:23,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=41a48046d69ae425294b4db759fbd5ff, UNASSIGN in 337 msec 2023-02-15 21:01:23,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e. 2023-02-15 21:01:23,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2fe7e513432ac3d1fa0bd53ba596cf1e: 2023-02-15 21:01:23,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:23,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc. 2023-02-15 21:01:23,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e8d8959cfe575eaef8c49ab9114f4dc: 2023-02-15 21:01:23,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:23,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2fe7e513432ac3d1fa0bd53ba596cf1e, regionState=CLOSED 2023-02-15 21:01:23,712 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883712"}]},"ts":"1676494883712"} 2023-02-15 21:01:23,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:23,713 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4e8d8959cfe575eaef8c49ab9114f4dc, regionState=CLOSED 2023-02-15 21:01:23,713 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494883713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494883713"}]},"ts":"1676494883713"} 2023-02-15 21:01:23,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-15 21:01:23,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 2fe7e513432ac3d1fa0bd53ba596cf1e, server=jenkins-hbase4.apache.org,43407,1676494872153 in 337 msec 2023-02-15 21:01:23,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-15 21:01:23,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 4e8d8959cfe575eaef8c49ab9114f4dc, server=jenkins-hbase4.apache.org,46537,1676494872102 in 327 msec 2023-02-15 21:01:23,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2fe7e513432ac3d1fa0bd53ba596cf1e, UNASSIGN in 358 msec 2023-02-15 21:01:23,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-15 21:01:23,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e8d8959cfe575eaef8c49ab9114f4dc, UNASSIGN in 359 msec 2023-02-15 21:01:23,721 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494883721"}]},"ts":"1676494883721"} 2023-02-15 21:01:23,722 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 21:01:23,804 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 21:01:23,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 463 msec 2023-02-15 21:01:23,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:23,960 INFO [Listener at localhost/45931] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-15 21:01:23,965 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-15 21:01:23,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:01:23,973 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:01:23,975 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:01:23,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:23,994 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:24,001 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/recovered.edits] 2023-02-15 21:01:24,013 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/recovered.edits] 2023-02-15 21:01:24,014 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/recovered.edits] 2023-02-15 21:01:24,014 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/recovered.edits] 2023-02-15 21:01:24,015 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/recovered.edits] 2023-02-15 21:01:24,016 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/recovered.edits] 2023-02-15 21:01:24,016 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/recovered.edits] 2023-02-15 21:01:24,017 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/recovered.edits] 2023-02-15 21:01:24,033 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a41f798eeea5414494b4527badecc812 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a41f798eeea5414494b4527badecc812 2023-02-15 21:01:24,035 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/31539920e281418f88f0218d2f44e80e to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/31539920e281418f88f0218d2f44e80e 2023-02-15 21:01:24,035 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/41bf9938dd654108855699f7e773946a to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/41bf9938dd654108855699f7e773946a 2023-02-15 21:01:24,035 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/77d64a7593a6451a94e66c302767c6dd to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/77d64a7593a6451a94e66c302767c6dd 2023-02-15 21:01:24,035 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/1471b02a38734bc4be9decdcb117cd18 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/1471b02a38734bc4be9decdcb117cd18 2023-02-15 21:01:24,035 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/915ab20ac40d40468c0a1c0f47ebf767 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/915ab20ac40d40468c0a1c0f47ebf767 2023-02-15 21:01:24,037 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a7431bb397fe4dec8a63bc56d6e3674e to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f1/a7431bb397fe4dec8a63bc56d6e3674e 2023-02-15 21:01:24,038 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/20871a5772fa4ea2b969649d00b35c68 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/20871a5772fa4ea2b969649d00b35c68 2023-02-15 21:01:24,039 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/recovered.edits/6.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1/recovered.edits/6.seqid 2023-02-15 21:01:24,039 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/dcf0ac2d8797404780999199131a60d5 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f1/dcf0ac2d8797404780999199131a60d5 2023-02-15 21:01:24,040 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/ee2c171a0193442f86f57672a2871940 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f1/ee2c171a0193442f86f57672a2871940 2023-02-15 21:01:24,040 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/be1406cddddd4e0eaed6197aa13da607 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f1/be1406cddddd4e0eaed6197aa13da607 2023-02-15 21:01:24,040 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/5dd4d1caf8cf4842a2cb7f49f4bb9c29 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f1/5dd4d1caf8cf4842a2cb7f49f4bb9c29 2023-02-15 21:01:24,041 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/e95917427afc43da90b4f3fd9576d81f to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f1/e95917427afc43da90b4f3fd9576d81f 2023-02-15 21:01:24,041 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/9d73cb52fd9edf2494d646aaf4ee9ba1 2023-02-15 21:01:24,041 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:24,041 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/726042b1fffa475d94bb452fd5b2910c to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f1/726042b1fffa475d94bb452fd5b2910c 2023-02-15 21:01:24,048 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/recovered.edits] 2023-02-15 21:01:24,049 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/384b630dac01439a90898264440ed156 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/384b630dac01439a90898264440ed156 2023-02-15 21:01:24,051 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/8119cb762e524bcc868f7036d31de240 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/8119cb762e524bcc868f7036d31de240 2023-02-15 21:01:24,052 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/60b41a03acab4d2badab68b795abb3b2 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/60b41a03acab4d2badab68b795abb3b2 2023-02-15 21:01:24,052 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/2ab6da6d13db4257b1532c8b45d97eb4 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/2ab6da6d13db4257b1532c8b45d97eb4 2023-02-15 21:01:24,052 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/3c43c62307d3469aabac406a3a9f63be to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/3c43c62307d3469aabac406a3a9f63be 2023-02-15 21:01:24,053 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/2d792a071f264ffdb42a01bd9dc3bd45 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/2d792a071f264ffdb42a01bd9dc3bd45 2023-02-15 21:01:24,053 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/c5709c6d4d3a49b398bac7e58ee9582b to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/c5709c6d4d3a49b398bac7e58ee9582b 2023-02-15 21:01:24,054 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/6e6e1e97ed994302b2581bde8fc73cd3 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/f2/6e6e1e97ed994302b2581bde8fc73cd3 2023-02-15 21:01:24,056 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/adae02ef667c425c86c433a7a5e4cac1 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/f2/adae02ef667c425c86c433a7a5e4cac1 2023-02-15 21:01:24,056 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/80ace24fe41c4432adf7bd2340602a3b to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/f2/80ace24fe41c4432adf7bd2340602a3b 2023-02-15 21:01:24,057 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/9cb4c73bda87462da5cefe4624b68433 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/f2/9cb4c73bda87462da5cefe4624b68433 2023-02-15 21:01:24,057 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/a37b833df874440d948c0e1503d8eef3 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/f2/a37b833df874440d948c0e1503d8eef3 2023-02-15 21:01:24,057 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/8af7301278fb49aa85e888e567ee3fad to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/f2/8af7301278fb49aa85e888e567ee3fad 2023-02-15 21:01:24,057 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/eec45586606d4fff889bc40ce3ee347f to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/f2/eec45586606d4fff889bc40ce3ee347f 2023-02-15 21:01:24,060 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/27023cef9c8d482e85e9d20852977994 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/27023cef9c8d482e85e9d20852977994 2023-02-15 21:01:24,064 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e/recovered.edits/12.seqid 2023-02-15 21:01:24,064 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a/recovered.edits/12.seqid 2023-02-15 21:01:24,064 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/8a80c3b616ac4d3abeeba93e113483c2 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f1/8a80c3b616ac4d3abeeba93e113483c2 2023-02-15 21:01:24,065 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/2fe7e513432ac3d1fa0bd53ba596cf1e 2023-02-15 21:01:24,065 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:24,065 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5/recovered.edits/12.seqid 2023-02-15 21:01:24,065 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e/recovered.edits/12.seqid 2023-02-15 21:01:24,065 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4180e496656aaf891e03297b96285b4a 2023-02-15 21:01:24,066 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc/recovered.edits/12.seqid 2023-02-15 21:01:24,066 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff/recovered.edits/12.seqid 2023-02-15 21:01:24,067 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/f647bdd8e70d71d94c0bff32e3dcf5f5 2023-02-15 21:01:24,067 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/3ab1350bfd6de7d89aa6948386a8b02e 2023-02-15 21:01:24,067 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4e8d8959cfe575eaef8c49ab9114f4dc 2023-02-15 21:01:24,067 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087/recovered.edits/12.seqid 2023-02-15 21:01:24,067 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/41a48046d69ae425294b4db759fbd5ff 2023-02-15 21:01:24,068 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d8d18736bb242ed1cd6ddf6f4838087 2023-02-15 21:01:24,068 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f1, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/f2, FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/recovered.edits] 2023-02-15 21:01:24,070 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/27612645741e4cba88a7f2346606f54a to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/27612645741e4cba88a7f2346606f54a 2023-02-15 21:01:24,072 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/c9abf07dbfc44919851cc7b05fcbf861 to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/f2/c9abf07dbfc44919851cc7b05fcbf861 2023-02-15 21:01:24,075 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/recovered.edits/6.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2/recovered.edits/6.seqid 2023-02-15 21:01:24,075 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/recovered.edits/12.seqid to hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/archive/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0/recovered.edits/12.seqid 2023-02-15 21:01:24,075 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/4d531ab9f1d8a3223cc76c23847a96c2 2023-02-15 21:01:24,076 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/.tmp/data/default/testWithMapReduce/0a252bdb931db8c92238de87c150baf0 2023-02-15 21:01:24,076 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 21:01:24,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 21:01:24,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:01:24,105 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-15 21:01:24,111 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,113 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494884113"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,116 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 21:01:24,116 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9d73cb52fd9edf2494d646aaf4ee9ba1, NAME => 'testWithMapReduce,,1676494875001.9d73cb52fd9edf2494d646aaf4ee9ba1.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => f647bdd8e70d71d94c0bff32e3dcf5f5, NAME => 'testWithMapReduce,aaa,1676494875001.f647bdd8e70d71d94c0bff32e3dcf5f5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 4d8d18736bb242ed1cd6ddf6f4838087, NAME => 'testWithMapReduce,d\x84\x84,1676494875001.4d8d18736bb242ed1cd6ddf6f4838087.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 4e8d8959cfe575eaef8c49ab9114f4dc, NAME => 'testWithMapReduce,g\xA7\xA7,1676494875001.4e8d8959cfe575eaef8c49ab9114f4dc.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 41a48046d69ae425294b4db759fbd5ff, NAME => 'testWithMapReduce,j\xCA\xCA,1676494875001.41a48046d69ae425294b4db759fbd5ff.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2fe7e513432ac3d1fa0bd53ba596cf1e, NAME => 'testWithMapReduce,m\xED\xED,1676494875001.2fe7e513432ac3d1fa0bd53ba596cf1e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 3ab1350bfd6de7d89aa6948386a8b02e, NAME => 'testWithMapReduce,q\x11\x10,1676494875001.3ab1350bfd6de7d89aa6948386a8b02e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 4180e496656aaf891e03297b96285b4a, NAME => 'testWithMapReduce,t43,1676494875001.4180e496656aaf891e03297b96285b4a.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 0a252bdb931db8c92238de87c150baf0, NAME => 'testWithMapReduce,wWV,1676494875001.0a252bdb931db8c92238de87c150baf0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 4d531ab9f1d8a3223cc76c23847a96c2, NAME => 'testWithMapReduce,zz{,1676494875001.4d531ab9f1d8a3223cc76c23847a96c2.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 21:01:24,116 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 21:01:24,116 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676494884116"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:24,118 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 21:01:24,158 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:01:24,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 192 msec 2023-02-15 21:01:24,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41737] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 21:01:24,281 INFO [Listener at localhost/45931] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-15 21:01:24,281 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:01:24,281 INFO [Listener at localhost/45931] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:01:24,281 DEBUG [Listener at localhost/45931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x659a4d79 to 127.0.0.1:51186 2023-02-15 21:01:24,281 DEBUG [Listener at localhost/45931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:24,282 DEBUG [Listener at localhost/45931] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:01:24,282 DEBUG [Listener at localhost/45931] util.JVMClusterUtil(257): Found active master hash=272379575, stopped=false 2023-02-15 21:01:24,282 INFO [Listener at localhost/45931] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:24,419 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:24,419 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:24,419 INFO [Listener at localhost/45931] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:01:24,419 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:24,421 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:24,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:24,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:24,421 DEBUG [Listener at localhost/45931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67e2f497 to 127.0.0.1:51186 2023-02-15 21:01:24,422 DEBUG [Listener at localhost/45931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:24,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:24,422 INFO [Listener at localhost/45931] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46537,1676494872102' ***** 2023-02-15 21:01:24,422 INFO [Listener at localhost/45931] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:24,422 INFO [Listener at localhost/45931] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43407,1676494872153' ***** 2023-02-15 21:01:24,422 INFO [Listener at localhost/45931] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:24,423 INFO [RS:1;jenkins-hbase4:43407] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:24,423 INFO [RS:0;jenkins-hbase4:46537] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:24,423 INFO [RS:1;jenkins-hbase4:43407] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:24,423 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:24,423 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:24,423 INFO [RS:1;jenkins-hbase4:43407] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:24,423 INFO [RS:0;jenkins-hbase4:46537] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:24,424 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:24,424 INFO [RS:0;jenkins-hbase4:46537] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:24,424 DEBUG [RS:1;jenkins-hbase4:43407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x193b3a6a to 127.0.0.1:51186 2023-02-15 21:01:24,424 DEBUG [RS:1;jenkins-hbase4:43407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:24,424 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(3304): Received CLOSE for 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:24,424 INFO [RS:1;jenkins-hbase4:43407] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:24,424 INFO [RS:1;jenkins-hbase4:43407] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:24,424 INFO [RS:1;jenkins-hbase4:43407] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:24,424 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:01:24,424 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:24,424 DEBUG [RS:0;jenkins-hbase4:46537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77e20efa to 127.0.0.1:51186 2023-02-15 21:01:24,425 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 21:01:24,425 DEBUG [RS:0;jenkins-hbase4:46537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:24,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2308ebc89837ac463f07998a2be36099, disabling compactions & flushes 2023-02-15 21:01:24,425 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 21:01:24,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:24,425 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 21:01:24,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:24,426 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1479): Online Regions={2308ebc89837ac463f07998a2be36099=hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099.} 2023-02-15 21:01:24,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:24,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:24,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:24,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:24,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:24,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. after waiting 0 ms 2023-02-15 21:01:24,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:24,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 2308ebc89837ac463f07998a2be36099 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:01:24,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-15 21:01:24,427 DEBUG [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1505): Waiting on 2308ebc89837ac463f07998a2be36099 2023-02-15 21:01:24,427 DEBUG [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 21:01:24,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/.tmp/info/6a7d12c4bc84424ca4de65e7e4f77187 2023-02-15 21:01:24,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/.tmp/info/d118c17b511d4817b6b99f71942b8381 2023-02-15 21:01:24,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d118c17b511d4817b6b99f71942b8381 2023-02-15 21:01:24,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/.tmp/info/6a7d12c4bc84424ca4de65e7e4f77187 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/info/6a7d12c4bc84424ca4de65e7e4f77187 2023-02-15 21:01:24,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/info/6a7d12c4bc84424ca4de65e7e4f77187, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:01:24,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2308ebc89837ac463f07998a2be36099 in 40ms, sequenceid=6, compaction requested=false 2023-02-15 21:01:24,475 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 21:01:24,475 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 21:01:24,479 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 21:01:24,479 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 21:01:24,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/.tmp/rep_barrier/80fd703425fc47de804de53c6b62146c 2023-02-15 21:01:24,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/namespace/2308ebc89837ac463f07998a2be36099/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:01:24,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:24,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2308ebc89837ac463f07998a2be36099: 2023-02-15 21:01:24,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494874095.2308ebc89837ac463f07998a2be36099. 2023-02-15 21:01:24,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80fd703425fc47de804de53c6b62146c 2023-02-15 21:01:24,490 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:24,490 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:24,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/.tmp/table/2c4ebcb3e8c74a5d8b37c446b1b8f8f9 2023-02-15 21:01:24,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c4ebcb3e8c74a5d8b37c446b1b8f8f9 2023-02-15 21:01:24,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/.tmp/info/d118c17b511d4817b6b99f71942b8381 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/info/d118c17b511d4817b6b99f71942b8381 2023-02-15 21:01:24,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d118c17b511d4817b6b99f71942b8381 2023-02-15 21:01:24,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/info/d118c17b511d4817b6b99f71942b8381, entries=30, sequenceid=57, filesize=7.9 K 2023-02-15 21:01:24,517 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/.tmp/rep_barrier/80fd703425fc47de804de53c6b62146c as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/rep_barrier/80fd703425fc47de804de53c6b62146c 2023-02-15 21:01:24,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80fd703425fc47de804de53c6b62146c 2023-02-15 21:01:24,523 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/rep_barrier/80fd703425fc47de804de53c6b62146c, entries=10, sequenceid=57, filesize=5.9 K 2023-02-15 21:01:24,524 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/.tmp/table/2c4ebcb3e8c74a5d8b37c446b1b8f8f9 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/table/2c4ebcb3e8c74a5d8b37c446b1b8f8f9 2023-02-15 21:01:24,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c4ebcb3e8c74a5d8b37c446b1b8f8f9 2023-02-15 21:01:24,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/table/2c4ebcb3e8c74a5d8b37c446b1b8f8f9, entries=13, sequenceid=57, filesize=5.9 K 2023-02-15 21:01:24,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 106ms, sequenceid=57, compaction requested=false 2023-02-15 21:01:24,543 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 21:01:24,543 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:24,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:24,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:24,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:24,628 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46537,1676494872102; all regions closed. 2023-02-15 21:01:24,628 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43407,1676494872153; all regions closed. 2023-02-15 21:01:24,636 DEBUG [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/oldWALs 2023-02-15 21:01:24,636 INFO [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43407%2C1676494872153.meta:.meta(num 1676494873819) 2023-02-15 21:01:24,636 DEBUG [RS:0;jenkins-hbase4:46537] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/oldWALs 2023-02-15 21:01:24,637 INFO [RS:0;jenkins-hbase4:46537] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46537%2C1676494872102:(num 1676494874536) 2023-02-15 21:01:24,637 DEBUG [RS:0;jenkins-hbase4:46537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:24,637 INFO [RS:0;jenkins-hbase4:46537] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:24,637 INFO [RS:0;jenkins-hbase4:46537] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:24,637 INFO [RS:0;jenkins-hbase4:46537] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:24,637 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:24,637 INFO [RS:0;jenkins-hbase4:46537] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:24,637 INFO [RS:0;jenkins-hbase4:46537] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:24,639 INFO [RS:0;jenkins-hbase4:46537] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46537 2023-02-15 21:01:24,640 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/WALs/jenkins-hbase4.apache.org,43407,1676494872153/jenkins-hbase4.apache.org%2C43407%2C1676494872153.1676494874536 not finished, retry = 0 2023-02-15 21:01:24,742 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:24,742 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:24,742 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46537,1676494872102 2023-02-15 21:01:24,743 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:24,743 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a6b99f0 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:24,743 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:24,743 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ca59173 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:24,743 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46537,1676494872102] 2023-02-15 21:01:24,744 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46537,1676494872102; numProcessing=1 2023-02-15 21:01:24,744 DEBUG [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/oldWALs 2023-02-15 21:01:24,744 INFO [RS:1;jenkins-hbase4:43407] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43407%2C1676494872153:(num 1676494874536) 2023-02-15 21:01:24,744 DEBUG [RS:1;jenkins-hbase4:43407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:24,744 INFO [RS:1;jenkins-hbase4:43407] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:24,744 INFO [RS:1;jenkins-hbase4:43407] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:24,745 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:24,746 INFO [RS:1;jenkins-hbase4:43407] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43407 2023-02-15 21:01:24,942 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43407,1676494872153 2023-02-15 21:01:24,942 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46537,1676494872102 already deleted, retry=false 2023-02-15 21:01:24,942 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e972b99 rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:24,942 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:24,942 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46537,1676494872102 expired; onlineServers=1 2023-02-15 21:01:24,949 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:24,949 INFO [RS:0;jenkins-hbase4:46537] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46537,1676494872102; zookeeper connection closed. 2023-02-15 21:01:24,949 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@548e6515 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:24,950 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:46537-0x10059c97fdb0001, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:24,950 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6bd74691 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:24,950 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1fadabe4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1fadabe4 2023-02-15 21:01:24,996 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43407,1676494872153] 2023-02-15 21:01:24,996 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43407,1676494872153; numProcessing=2 2023-02-15 21:01:25,073 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43407,1676494872153 already deleted, retry=false 2023-02-15 21:01:25,073 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43407,1676494872153 expired; onlineServers=0 2023-02-15 21:01:25,074 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41737,1676494870941' ***** 2023-02-15 21:01:25,074 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:01:25,074 DEBUG [M:0;jenkins-hbase4:41737] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5101248c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:25,074 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41737,1676494870941 2023-02-15 21:01:25,074 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41737,1676494870941; all regions closed. 2023-02-15 21:01:25,075 DEBUG [M:0;jenkins-hbase4:41737] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:25,075 DEBUG [M:0;jenkins-hbase4:41737] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:01:25,075 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:01:25,075 DEBUG [M:0;jenkins-hbase4:41737] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:01:25,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494873299] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494873299,5,FailOnTimeoutGroup] 2023-02-15 21:01:25,076 INFO [M:0;jenkins-hbase4:41737] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:01:25,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494873300] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494873300,5,FailOnTimeoutGroup] 2023-02-15 21:01:25,076 INFO [M:0;jenkins-hbase4:41737] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:01:25,077 INFO [M:0;jenkins-hbase4:41737] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:01:25,078 DEBUG [M:0;jenkins-hbase4:41737] master.HMaster(1512): Stopping service threads 2023-02-15 21:01:25,078 INFO [M:0;jenkins-hbase4:41737] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:01:25,078 ERROR [M:0;jenkins-hbase4:41737] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-15 21:01:25,079 INFO [M:0;jenkins-hbase4:41737] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:01:25,079 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:01:25,096 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:25,096 INFO [RS:1;jenkins-hbase4:43407] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43407,1676494872153; zookeeper connection closed. 2023-02-15 21:01:25,096 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49d33a7f rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:25,096 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31ca009e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31ca009e 2023-02-15 21:01:25,096 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): regionserver:43407-0x10059c97fdb0002, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:25,096 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@318c5e4f rejected from java.util.concurrent.ThreadPoolExecutor@3aa8b893[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:25,096 INFO [Listener at localhost/45931] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:01:25,172 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:25,172 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:25,172 DEBUG [M:0;jenkins-hbase4:41737] zookeeper.ZKUtil(398): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:01:25,173 WARN [M:0;jenkins-hbase4:41737] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:01:25,173 INFO [M:0;jenkins-hbase4:41737] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:01:25,173 INFO [M:0;jenkins-hbase4:41737] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:01:25,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:25,174 DEBUG [M:0;jenkins-hbase4:41737] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:25,174 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:25,174 DEBUG [M:0;jenkins-hbase4:41737] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:25,174 DEBUG [M:0;jenkins-hbase4:41737] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:25,174 DEBUG [M:0;jenkins-hbase4:41737] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:25,174 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.23 KB heapSize=192.14 KB 2023-02-15 21:01:25,191 INFO [M:0;jenkins-hbase4:41737] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.23 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2d4edf7ae0644a79aa40d7d9d6f81a46 2023-02-15 21:01:25,197 DEBUG [M:0;jenkins-hbase4:41737] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2d4edf7ae0644a79aa40d7d9d6f81a46 as hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2d4edf7ae0644a79aa40d7d9d6f81a46 2023-02-15 21:01:25,202 INFO [M:0;jenkins-hbase4:41737] regionserver.HStore(1080): Added hdfs://localhost:42563/user/jenkins/test-data/315ca0fd-a50d-da97-a5e1-b8349907033b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2d4edf7ae0644a79aa40d7d9d6f81a46, entries=53, sequenceid=357, filesize=10.4 K 2023-02-15 21:01:25,203 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegion(2947): Finished flush of dataSize ~159.23 KB/163056, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=357, compaction requested=false 2023-02-15 21:01:25,205 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:25,205 DEBUG [M:0;jenkins-hbase4:41737] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:25,209 INFO [M:0;jenkins-hbase4:41737] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:01:25,209 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:25,210 INFO [M:0;jenkins-hbase4:41737] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41737 2023-02-15 21:01:25,304 DEBUG [M:0;jenkins-hbase4:41737] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41737,1676494870941 already deleted, retry=false 2023-02-15 21:01:25,488 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:25,488 INFO [M:0;jenkins-hbase4:41737] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41737,1676494870941; zookeeper connection closed. 2023-02-15 21:01:25,488 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e65539d rejected from java.util.concurrent.ThreadPoolExecutor@60582bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:25,488 DEBUG [Listener at localhost/45931-EventThread] zookeeper.ZKWatcher(600): master:41737-0x10059c97fdb0000, quorum=127.0.0.1:51186, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:25,488 ERROR [Listener at localhost/45931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6eb6504a rejected from java.util.concurrent.ThreadPoolExecutor@60582bcf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:25,490 WARN [Listener at localhost/45931] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:25,495 INFO [Listener at localhost/45931] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:25,598 WARN [BP-732720125-172.31.14.131-1676494867545 heartbeating to localhost/127.0.0.1:42563] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:25,599 WARN [BP-732720125-172.31.14.131-1676494867545 heartbeating to localhost/127.0.0.1:42563] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-732720125-172.31.14.131-1676494867545 (Datanode Uuid 08d40c85-87d4-492b-95c4-349344948d89) service to localhost/127.0.0.1:42563 2023-02-15 21:01:25,600 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/dfs/data/data3/current/BP-732720125-172.31.14.131-1676494867545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:25,600 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/dfs/data/data4/current/BP-732720125-172.31.14.131-1676494867545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:25,602 WARN [Listener at localhost/45931] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:25,610 INFO [Listener at localhost/45931] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:25,714 WARN [BP-732720125-172.31.14.131-1676494867545 heartbeating to localhost/127.0.0.1:42563] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:25,714 WARN [BP-732720125-172.31.14.131-1676494867545 heartbeating to localhost/127.0.0.1:42563] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-732720125-172.31.14.131-1676494867545 (Datanode Uuid 9b953166-0088-4ef7-92a0-ce557616bc1a) service to localhost/127.0.0.1:42563 2023-02-15 21:01:25,715 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/dfs/data/data1/current/BP-732720125-172.31.14.131-1676494867545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:25,715 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/cluster_6acdf960-5542-44ca-ac17-1bcf0bdcb90e/dfs/data/data2/current/BP-732720125-172.31.14.131-1676494867545] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:25,750 INFO [Listener at localhost/45931] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:25,871 INFO [Listener at localhost/45931] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:01:25,946 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:01:25,961 INFO [Listener at localhost/45931] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42563 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45931 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,41737,1676494870941)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:42563 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42563 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:42563 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@2659d5c6 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42563 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=529 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 179) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3024 (was 4051) 2023-02-15 21:01:25,971 INFO [Listener at localhost/45931] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=529, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=166, AvailableMemoryMB=3024 2023-02-15 21:01:25,981 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop.log.dir so I do NOT create it in target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f 2023-02-15 21:01:25,981 WARN [Listener at localhost/45931] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 21:01:25,981 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop.tmp.dir so I do NOT create it in target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f 2023-02-15 21:01:25,981 WARN [Listener at localhost/45931] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/622aa388-9760-4770-b2cc-b03d963ce5ea/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 21:01:25,982 DEBUG [Listener at localhost/45931] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0, deleteOnExit=true 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/test.cache.data in system properties and HBase conf 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:25,982 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:25,983 DEBUG [Listener at localhost/45931] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:25,983 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:25,984 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:25,984 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:25,984 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:25,984 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:25,984 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:25,984 INFO [Listener at localhost/45931] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:25,989 WARN [Listener at localhost/45931] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:25,990 WARN [Listener at localhost/45931] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:26,742 WARN [Listener at localhost/45931] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:26,746 INFO [Listener at localhost/45931] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:26,753 INFO [Listener at localhost/45931] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/java.io.tmpdir/Jetty_localhost_33529_hdfs____.d5j7ui/webapp 2023-02-15 21:01:26,914 INFO [Listener at localhost/45931] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33529 2023-02-15 21:01:26,975 WARN [Listener at localhost/45931] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:26,975 WARN [Listener at localhost/45931] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:27,019 WARN [Listener at localhost/35019] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:27,037 WARN [Listener at localhost/35019] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:27,039 WARN [Listener at localhost/35019] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:27,041 INFO [Listener at localhost/35019] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:27,046 INFO [Listener at localhost/35019] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/java.io.tmpdir/Jetty_localhost_38547_datanode____.jjd02u/webapp 2023-02-15 21:01:27,148 INFO [Listener at localhost/35019] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38547 2023-02-15 21:01:27,158 WARN [Listener at localhost/45673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:27,177 WARN [Listener at localhost/45673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:27,179 WARN [Listener at localhost/45673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:27,180 INFO [Listener at localhost/45673] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:27,186 INFO [Listener at localhost/45673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/java.io.tmpdir/Jetty_localhost_34079_datanode____.35g2h4/webapp 2023-02-15 21:01:27,289 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8fe0666b9384b93c: Processing first storage report for DS-c40f6f21-b32d-4b48-8f24-20fa1c307293 from datanode e67f3bd7-4c03-48b3-b883-59fd036f3df3 2023-02-15 21:01:27,290 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8fe0666b9384b93c: from storage DS-c40f6f21-b32d-4b48-8f24-20fa1c307293 node DatanodeRegistration(127.0.0.1:41931, datanodeUuid=e67f3bd7-4c03-48b3-b883-59fd036f3df3, infoPort=46803, infoSecurePort=0, ipcPort=45673, storageInfo=lv=-57;cid=testClusterID;nsid=710068846;c=1676494885996), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:27,290 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8fe0666b9384b93c: Processing first storage report for DS-94005726-3d13-4c8e-b7ef-05fb002a4339 from datanode e67f3bd7-4c03-48b3-b883-59fd036f3df3 2023-02-15 21:01:27,290 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8fe0666b9384b93c: from storage DS-94005726-3d13-4c8e-b7ef-05fb002a4339 node DatanodeRegistration(127.0.0.1:41931, datanodeUuid=e67f3bd7-4c03-48b3-b883-59fd036f3df3, infoPort=46803, infoSecurePort=0, ipcPort=45673, storageInfo=lv=-57;cid=testClusterID;nsid=710068846;c=1676494885996), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:27,311 INFO [Listener at localhost/45673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34079 2023-02-15 21:01:27,320 WARN [Listener at localhost/33425] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:27,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9ac06ee450b815d3: Processing first storage report for DS-d063fb35-f370-4201-9f0e-f2aa7979cb46 from datanode 7cf6d44f-fc88-4e6d-8f13-34145080968a 2023-02-15 21:01:27,435 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9ac06ee450b815d3: from storage DS-d063fb35-f370-4201-9f0e-f2aa7979cb46 node DatanodeRegistration(127.0.0.1:44933, datanodeUuid=7cf6d44f-fc88-4e6d-8f13-34145080968a, infoPort=34247, infoSecurePort=0, ipcPort=33425, storageInfo=lv=-57;cid=testClusterID;nsid=710068846;c=1676494885996), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 21:01:27,435 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9ac06ee450b815d3: Processing first storage report for DS-bd2088fa-e913-4631-93b6-08efc977a720 from datanode 7cf6d44f-fc88-4e6d-8f13-34145080968a 2023-02-15 21:01:27,435 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9ac06ee450b815d3: from storage DS-bd2088fa-e913-4631-93b6-08efc977a720 node DatanodeRegistration(127.0.0.1:44933, datanodeUuid=7cf6d44f-fc88-4e6d-8f13-34145080968a, infoPort=34247, infoSecurePort=0, ipcPort=33425, storageInfo=lv=-57;cid=testClusterID;nsid=710068846;c=1676494885996), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:27,446 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f 2023-02-15 21:01:27,453 INFO [Listener at localhost/33425] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/zookeeper_0, clientPort=55483, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:27,455 INFO [Listener at localhost/33425] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55483 2023-02-15 21:01:27,455 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,456 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,490 INFO [Listener at localhost/33425] util.FSUtils(479): Created version file at hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2 with version=8 2023-02-15 21:01:27,491 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,492 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,493 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/hbase-staging 2023-02-15 21:01:27,495 INFO [Listener at localhost/33425] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:27,495 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,496 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,496 INFO [Listener at localhost/33425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:27,496 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,496 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:27,496 INFO [Listener at localhost/33425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:27,499 INFO [Listener at localhost/33425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34955 2023-02-15 21:01:27,499 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,501 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,502 INFO [Listener at localhost/33425] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34955 connecting to ZooKeeper ensemble=127.0.0.1:55483 2023-02-15 21:01:27,528 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:349550x0, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:27,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34955-0x10059c9c3dd0000 connected 2023-02-15 21:01:27,557 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:27,557 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:27,558 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:27,560 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34955 2023-02-15 21:01:27,560 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34955 2023-02-15 21:01:27,560 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34955 2023-02-15 21:01:27,564 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34955 2023-02-15 21:01:27,564 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34955 2023-02-15 21:01:27,564 INFO [Listener at localhost/33425] master.HMaster(444): hbase.rootdir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2, hbase.cluster.distributed=false 2023-02-15 21:01:27,582 INFO [Listener at localhost/33425] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:27,582 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,583 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,583 INFO [Listener at localhost/33425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:27,583 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,583 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:27,583 INFO [Listener at localhost/33425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:27,591 INFO [Listener at localhost/33425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33367 2023-02-15 21:01:27,591 INFO [Listener at localhost/33425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:27,592 DEBUG [Listener at localhost/33425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:27,593 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,594 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,596 INFO [Listener at localhost/33425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33367 connecting to ZooKeeper ensemble=127.0.0.1:55483 2023-02-15 21:01:27,599 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:333670x0, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:27,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33367-0x10059c9c3dd0001 connected 2023-02-15 21:01:27,601 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:27,601 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:27,602 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:27,604 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33367 2023-02-15 21:01:27,604 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33367 2023-02-15 21:01:27,605 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33367 2023-02-15 21:01:27,608 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33367 2023-02-15 21:01:27,610 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33367 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:27,625 INFO [Listener at localhost/33425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:27,630 INFO [Listener at localhost/33425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43709 2023-02-15 21:01:27,630 INFO [Listener at localhost/33425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:27,636 DEBUG [Listener at localhost/33425] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:27,637 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,638 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,639 INFO [Listener at localhost/33425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43709 connecting to ZooKeeper ensemble=127.0.0.1:55483 2023-02-15 21:01:27,647 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:437090x0, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:27,648 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): regionserver:437090x0, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:27,649 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): regionserver:437090x0, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:27,652 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(164): regionserver:437090x0, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:27,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43709-0x10059c9c3dd0002 connected 2023-02-15 21:01:27,665 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43709 2023-02-15 21:01:27,665 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43709 2023-02-15 21:01:27,665 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43709 2023-02-15 21:01:27,666 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43709 2023-02-15 21:01:27,666 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43709 2023-02-15 21:01:27,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,670 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:27,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,672 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:27,672 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:27,672 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:27,673 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:27,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:27,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34955,1676494887495 from backup master directory 2023-02-15 21:01:27,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:27,676 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,676 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:27,676 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:27,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/hbase.id with ID: 3ae9c617-a193-4ca4-a5ec-bfdb4de1bb2d 2023-02-15 21:01:27,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:27,719 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:27,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3c91b748 to 127.0.0.1:55483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:27,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e0472cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:27,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:27,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:27,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:27,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store-tmp 2023-02-15 21:01:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:27,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:27,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:27,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:27,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/WALs/jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34955%2C1676494887495, suffix=, logDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/WALs/jenkins-hbase4.apache.org,34955,1676494887495, archiveDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:27,790 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK] 2023-02-15 21:01:27,791 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK] 2023-02-15 21:01:27,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/WALs/jenkins-hbase4.apache.org,34955,1676494887495/jenkins-hbase4.apache.org%2C34955%2C1676494887495.1676494887769 2023-02-15 21:01:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK], DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK]] 2023-02-15 21:01:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:27,798 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:27,800 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:27,801 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:27,801 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:27,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:27,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:27,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:27,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:27,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71603893, jitterRate=0.06698115170001984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:27,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:27,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:27,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:27,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:27,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:27,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 21:01:27,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 21:01:27,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:27,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:27,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:27,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:27,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:27,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:27,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:27,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:27,841 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:27,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:27,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:27,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:27,844 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:27,844 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:27,844 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:27,844 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:27,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34955,1676494887495, sessionid=0x10059c9c3dd0000, setting cluster-up flag (Was=false) 2023-02-15 21:01:27,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:27,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,858 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:27,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:27,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:27,865 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.hbase-snapshot/.tmp 2023-02-15 21:01:27,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:27,868 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(952): ClusterId : 3ae9c617-a193-4ca4-a5ec-bfdb4de1bb2d 2023-02-15 21:01:27,868 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(952): ClusterId : 3ae9c617-a193-4ca4-a5ec-bfdb4de1bb2d 2023-02-15 21:01:27,868 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:27,868 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:27,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,873 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:27,873 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:27,875 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:27,876 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:27,876 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494917877 2023-02-15 21:01:27,877 DEBUG [RS:1;jenkins-hbase4:43709] zookeeper.ReadOnlyZKClient(139): Connect 0x70ab45a5 to 127.0.0.1:55483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:27,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:27,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:27,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,878 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:27,878 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:27,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:27,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:27,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:27,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:27,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:27,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494887880,5,FailOnTimeoutGroup] 2023-02-15 21:01:27,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494887880,5,FailOnTimeoutGroup] 2023-02-15 21:01:27,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:27,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,882 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:27,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,882 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:27,883 DEBUG [RS:0;jenkins-hbase4:33367] zookeeper.ReadOnlyZKClient(139): Connect 0x6356f1fe to 127.0.0.1:55483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:27,886 DEBUG [RS:1;jenkins-hbase4:43709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e6ca5c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:27,887 DEBUG [RS:1;jenkins-hbase4:43709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a532ed5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:27,891 DEBUG [RS:0;jenkins-hbase4:33367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d9103e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:27,892 DEBUG [RS:0;jenkins-hbase4:33367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69ae9a8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:27,896 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:27,897 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:27,897 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2 2023-02-15 21:01:27,898 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43709 2023-02-15 21:01:27,898 INFO [RS:1;jenkins-hbase4:43709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:27,898 INFO [RS:1;jenkins-hbase4:43709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:27,898 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:27,899 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34955,1676494887495 with isa=jenkins-hbase4.apache.org/172.31.14.131:43709, startcode=1676494887624 2023-02-15 21:01:27,899 DEBUG [RS:1;jenkins-hbase4:43709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:27,902 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50597, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:27,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,904 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2 2023-02-15 21:01:27,904 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35019 2023-02-15 21:01:27,904 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:27,905 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33367 2023-02-15 21:01:27,905 INFO [RS:0;jenkins-hbase4:33367] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:27,905 INFO [RS:0;jenkins-hbase4:33367] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:27,905 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:27,905 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:27,906 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34955,1676494887495 with isa=jenkins-hbase4.apache.org/172.31.14.131:33367, startcode=1676494887582 2023-02-15 21:01:27,906 DEBUG [RS:0;jenkins-hbase4:33367] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:27,906 DEBUG [RS:1;jenkins-hbase4:43709] zookeeper.ZKUtil(162): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,906 WARN [RS:1;jenkins-hbase4:43709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:27,907 INFO [RS:1;jenkins-hbase4:43709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:27,907 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43709,1676494887624] 2023-02-15 21:01:27,907 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,911 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49519, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:27,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:27,912 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:27,913 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2 2023-02-15 21:01:27,913 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35019 2023-02-15 21:01:27,913 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:27,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:27,917 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/info 2023-02-15 21:01:27,917 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:27,918 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:27,918 DEBUG [RS:1;jenkins-hbase4:43709] zookeeper.ZKUtil(162): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,918 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:27,918 DEBUG [RS:0;jenkins-hbase4:33367] zookeeper.ZKUtil(162): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:27,918 WARN [RS:0;jenkins-hbase4:33367] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:27,918 INFO [RS:0;jenkins-hbase4:33367] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:27,918 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:27,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:27,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:27,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,920 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33367,1676494887582] 2023-02-15 21:01:27,920 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:27,920 INFO [RS:1;jenkins-hbase4:43709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:27,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:27,924 INFO [RS:1;jenkins-hbase4:43709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:27,925 INFO [RS:1;jenkins-hbase4:43709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:27,925 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,926 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:27,927 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:27,928 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:27,928 DEBUG [RS:0;jenkins-hbase4:33367] zookeeper.ZKUtil(162): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,929 DEBUG [RS:0;jenkins-hbase4:33367] zookeeper.ZKUtil(162): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:27,929 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,929 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:27,929 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:27,929 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,929 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,930 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,930 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:27,930 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,930 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:27,930 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,930 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,930 INFO [RS:0;jenkins-hbase4:33367] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:27,930 DEBUG [RS:1;jenkins-hbase4:43709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,933 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/table 2023-02-15 21:01:27,934 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:27,934 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:27,940 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,941 INFO [RS:0;jenkins-hbase4:33367] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:27,941 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,941 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,944 INFO [RS:0;jenkins-hbase4:33367] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:27,944 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,944 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740 2023-02-15 21:01:27,945 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740 2023-02-15 21:01:27,947 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:27,948 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:27,950 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,950 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,950 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,951 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,951 DEBUG [RS:0;jenkins-hbase4:33367] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:27,959 INFO [RS:1;jenkins-hbase4:43709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:27,959 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43709,1676494887624-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,967 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,967 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,967 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,976 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:27,977 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72475349, jitterRate=0.07996685802936554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:27,977 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:27,977 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:27,977 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:27,977 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:27,977 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:27,977 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:27,986 INFO [RS:1;jenkins-hbase4:43709] regionserver.Replication(203): jenkins-hbase4.apache.org,43709,1676494887624 started 2023-02-15 21:01:27,986 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:27,986 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:27,986 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43709,1676494887624, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43709, sessionid=0x10059c9c3dd0002 2023-02-15 21:01:27,986 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:27,986 DEBUG [RS:1;jenkins-hbase4:43709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,986 DEBUG [RS:1;jenkins-hbase4:43709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43709,1676494887624' 2023-02-15 21:01:27,986 DEBUG [RS:1;jenkins-hbase4:43709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:27,987 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:27,987 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:27,987 INFO [RS:0;jenkins-hbase4:33367] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:27,987 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33367,1676494887582-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:27,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:27,988 DEBUG [RS:1;jenkins-hbase4:43709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:27,990 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:27,991 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:27,991 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:27,991 DEBUG [RS:1;jenkins-hbase4:43709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:27,991 DEBUG [RS:1;jenkins-hbase4:43709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43709,1676494887624' 2023-02-15 21:01:27,992 DEBUG [RS:1;jenkins-hbase4:43709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:27,992 DEBUG [RS:1;jenkins-hbase4:43709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:27,993 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:27,993 DEBUG [RS:1;jenkins-hbase4:43709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:27,993 INFO [RS:1;jenkins-hbase4:43709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:27,993 INFO [RS:1;jenkins-hbase4:43709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:28,002 INFO [RS:0;jenkins-hbase4:33367] regionserver.Replication(203): jenkins-hbase4.apache.org,33367,1676494887582 started 2023-02-15 21:01:28,003 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33367,1676494887582, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33367, sessionid=0x10059c9c3dd0001 2023-02-15 21:01:28,003 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:28,003 DEBUG [RS:0;jenkins-hbase4:33367] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:28,003 DEBUG [RS:0;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33367,1676494887582' 2023-02-15 21:01:28,003 DEBUG [RS:0;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:28,003 DEBUG [RS:0;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:28,004 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:28,004 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:28,004 DEBUG [RS:0;jenkins-hbase4:33367] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:28,004 DEBUG [RS:0;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33367,1676494887582' 2023-02-15 21:01:28,004 DEBUG [RS:0;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:28,004 DEBUG [RS:0;jenkins-hbase4:33367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:28,005 DEBUG [RS:0;jenkins-hbase4:33367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:28,005 INFO [RS:0;jenkins-hbase4:33367] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:28,005 INFO [RS:0;jenkins-hbase4:33367] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:28,143 DEBUG [jenkins-hbase4:34955] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:28,143 DEBUG [jenkins-hbase4:34955] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:28,145 DEBUG [jenkins-hbase4:34955] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:28,145 DEBUG [jenkins-hbase4:34955] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:28,145 DEBUG [jenkins-hbase4:34955] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:28,147 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33367,1676494887582, state=OPENING 2023-02-15 21:01:28,149 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:28,150 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:28,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:28,151 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:28,306 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:28,306 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:28,310 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40714, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:28,317 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:28,317 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:28,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33367%2C1676494887582.meta, suffix=.meta, logDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,33367,1676494887582, archiveDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/oldWALs, maxLogs=32 2023-02-15 21:01:28,337 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK] 2023-02-15 21:01:28,338 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK] 2023-02-15 21:01:28,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,33367,1676494887582/jenkins-hbase4.apache.org%2C33367%2C1676494887582.meta.1676494888320.meta 2023-02-15 21:01:28,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK], DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK]] 2023-02-15 21:01:28,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:28,341 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:28,341 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:28,342 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:28,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:28,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:28,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:28,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:28,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:28,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/info 2023-02-15 21:01:28,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/info 2023-02-15 21:01:28,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:28,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:28,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:28,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:28,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:28,353 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:28,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:28,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:28,355 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/table 2023-02-15 21:01:28,355 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/table 2023-02-15 21:01:28,356 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:28,356 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:28,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740 2023-02-15 21:01:28,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740 2023-02-15 21:01:28,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:28,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:28,364 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74812565, jitterRate=0.11479409039020538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:28,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:28,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494888306 2023-02-15 21:01:28,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:28,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:28,369 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33367,1676494887582, state=OPEN 2023-02-15 21:01:28,371 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:28,371 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:28,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:28,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33367,1676494887582 in 220 msec 2023-02-15 21:01:28,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:28,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 386 msec 2023-02-15 21:01:28,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 509 msec 2023-02-15 21:01:28,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494888376, completionTime=-1 2023-02-15 21:01:28,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:28,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:28,380 DEBUG [hconnection-0x460b86d4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:28,383 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:28,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:28,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494948384 2023-02-15 21:01:28,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676495008384 2023-02-15 21:01:28,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-15 21:01:28,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34955,1676494887495-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:28,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34955,1676494887495-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:28,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34955,1676494887495-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:28,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34955, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:28,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:28,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:28,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:28,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:28,393 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:28,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:28,395 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:28,397 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,397 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b empty. 2023-02-15 21:01:28,398 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,398 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:28,409 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:28,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5fa18c137669e4b994f2f2fb63d85f7b, NAME => 'hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:28,422 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:28,422 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5fa18c137669e4b994f2f2fb63d85f7b, disabling compactions & flushes 2023-02-15 21:01:28,422 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,422 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,422 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. after waiting 0 ms 2023-02-15 21:01:28,422 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,422 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,422 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5fa18c137669e4b994f2f2fb63d85f7b: 2023-02-15 21:01:28,425 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:28,426 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494888426"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494888426"}]},"ts":"1676494888426"} 2023-02-15 21:01:28,428 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:28,430 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:28,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494888430"}]},"ts":"1676494888430"} 2023-02-15 21:01:28,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:28,434 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:28,435 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:28,435 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:28,435 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:28,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5fa18c137669e4b994f2f2fb63d85f7b, ASSIGN}] 2023-02-15 21:01:28,438 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5fa18c137669e4b994f2f2fb63d85f7b, ASSIGN 2023-02-15 21:01:28,439 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5fa18c137669e4b994f2f2fb63d85f7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676494887582; forceNewPlan=false, retain=false 2023-02-15 21:01:28,589 INFO [jenkins-hbase4:34955] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:28,590 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5fa18c137669e4b994f2f2fb63d85f7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:28,590 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494888590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494888590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494888590"}]},"ts":"1676494888590"} 2023-02-15 21:01:28,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5fa18c137669e4b994f2f2fb63d85f7b, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:28,749 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,751 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33367%2C1676494887582, suffix=, logDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,33367,1676494887582, archiveDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/oldWALs, maxLogs=32 2023-02-15 21:01:28,775 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK] 2023-02-15 21:01:28,776 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK] 2023-02-15 21:01:28,778 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,33367,1676494887582/jenkins-hbase4.apache.org%2C33367%2C1676494887582.1676494888752 2023-02-15 21:01:28,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK], DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK]] 2023-02-15 21:01:28,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fa18c137669e4b994f2f2fb63d85f7b, NAME => 'hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:28,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:28,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,780 INFO [StoreOpener-5fa18c137669e4b994f2f2fb63d85f7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,782 DEBUG [StoreOpener-5fa18c137669e4b994f2f2fb63d85f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/info 2023-02-15 21:01:28,782 DEBUG [StoreOpener-5fa18c137669e4b994f2f2fb63d85f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/info 2023-02-15 21:01:28,782 INFO [StoreOpener-5fa18c137669e4b994f2f2fb63d85f7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fa18c137669e4b994f2f2fb63d85f7b columnFamilyName info 2023-02-15 21:01:28,783 INFO [StoreOpener-5fa18c137669e4b994f2f2fb63d85f7b-1] regionserver.HStore(310): Store=5fa18c137669e4b994f2f2fb63d85f7b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:28,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:28,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:28,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5fa18c137669e4b994f2f2fb63d85f7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71472486, jitterRate=0.0650230348110199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:28,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5fa18c137669e4b994f2f2fb63d85f7b: 2023-02-15 21:01:28,790 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b., pid=6, masterSystemTime=1676494888744 2023-02-15 21:01:28,793 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,793 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:28,793 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5fa18c137669e4b994f2f2fb63d85f7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:28,793 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494888793"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494888793"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494888793"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494888793"}]},"ts":"1676494888793"} 2023-02-15 21:01:28,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:28,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5fa18c137669e4b994f2f2fb63d85f7b, server=jenkins-hbase4.apache.org,33367,1676494887582 in 203 msec 2023-02-15 21:01:28,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:28,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5fa18c137669e4b994f2f2fb63d85f7b, ASSIGN in 362 msec 2023-02-15 21:01:28,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:28,801 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494888801"}]},"ts":"1676494888801"} 2023-02-15 21:01:28,803 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:28,811 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:28,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 419 msec 2023-02-15 21:01:28,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:28,895 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:28,895 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:28,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:28,910 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:28,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-15 21:01:28,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:28,931 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:28,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-15 21:01:28,946 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:28,949 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:28,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.273sec 2023-02-15 21:01:28,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:28,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:28,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:28,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34955,1676494887495-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:28,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34955,1676494887495-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:28,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:28,968 DEBUG [Listener at localhost/33425] zookeeper.ReadOnlyZKClient(139): Connect 0x064951b6 to 127.0.0.1:55483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:28,973 DEBUG [Listener at localhost/33425] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bd3f96a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:28,975 DEBUG [hconnection-0x787a932e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:28,978 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40730, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:28,980 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:28,980 DEBUG [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:28,983 DEBUG [Listener at localhost/33425] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:28,985 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:28,986 INFO [Listener at localhost/33425] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 21:01:28,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 21:01:28,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:28,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:53162 deadline: 1676494948986, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 21:01:28,987 INFO [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 21:01:28,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:28,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 21:01:28,993 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:28,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 21:01:28,994 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:28,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:28,995 INFO [RS:1;jenkins-hbase4:43709] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43709%2C1676494887624, suffix=, logDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,43709,1676494887624, archiveDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/oldWALs, maxLogs=32 2023-02-15 21:01:29,003 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,003 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,004 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,004 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,004 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,003 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,003 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,003 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,004 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73 empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090 empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876 empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99 empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf empty. 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,005 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,006 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,006 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,006 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,006 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,006 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,006 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da empty. 2023-02-15 21:01:29,007 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063 empty. 2023-02-15 21:01:29,007 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,007 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,007 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,007 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 21:01:29,017 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK] 2023-02-15 21:01:29,017 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK] 2023-02-15 21:01:29,031 INFO [RS:1;jenkins-hbase4:43709] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/WALs/jenkins-hbase4.apache.org,43709,1676494887624/jenkins-hbase4.apache.org%2C43709%2C1676494887624.1676494888996 2023-02-15 21:01:29,036 DEBUG [RS:1;jenkins-hbase4:43709] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44933,DS-d063fb35-f370-4201-9f0e-f2aa7979cb46,DISK], DatanodeInfoWithStorage[127.0.0.1:41931,DS-c40f6f21-b32d-4b48-8f24-20fa1c307293,DISK]] 2023-02-15 21:01:29,037 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:29,039 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9b6caa699073c6abe425d26e7dc3518f, NAME => 'testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 29e99b3a6b63453a9e70481c093d51bf, NAME => 'testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,054 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => dc976705211f99d13495c680e21a1f7b, NAME => 'testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,059 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 21:01:29,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:29,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing dc976705211f99d13495c680e21a1f7b, disabling compactions & flushes 2023-02-15 21:01:29,128 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. after waiting 0 ms 2023-02-15 21:01:29,128 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,128 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,129 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:29,129 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 43fb4f5a4a4445bf6be71546c7897e99, NAME => 'testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9b6caa699073c6abe425d26e7dc3518f, disabling compactions & flushes 2023-02-15 21:01:29,130 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. after waiting 0 ms 2023-02-15 21:01:29,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,130 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,130 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:29,130 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 618a9e646ce2cfbf1737008291010876, NAME => 'testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 29e99b3a6b63453a9e70481c093d51bf, disabling compactions & flushes 2023-02-15 21:01:29,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. after waiting 0 ms 2023-02-15 21:01:29,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:29,141 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 622d88e18bc49271e0c86cfefb4fd090, NAME => 'testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 618a9e646ce2cfbf1737008291010876, disabling compactions & flushes 2023-02-15 21:01:29,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. after waiting 0 ms 2023-02-15 21:01:29,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:29,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b4a3bb5db3fb5bc1e1bdc8e6d23242ad, NAME => 'testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 43fb4f5a4a4445bf6be71546c7897e99, disabling compactions & flushes 2023-02-15 21:01:29,216 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. after waiting 0 ms 2023-02-15 21:01:29,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,216 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,216 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:29,217 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 47ac5746381319486a87bab039f7dc73, NAME => 'testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,223 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,223 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 622d88e18bc49271e0c86cfefb4fd090, disabling compactions & flushes 2023-02-15 21:01:29,223 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,223 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,224 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. after waiting 0 ms 2023-02-15 21:01:29,224 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,224 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,224 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:29,224 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a92a92f4d2fefe2acd5c29ba52247063, NAME => 'testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b4a3bb5db3fb5bc1e1bdc8e6d23242ad, disabling compactions & flushes 2023-02-15 21:01:29,245 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. after waiting 0 ms 2023-02-15 21:01:29,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,246 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:29,246 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f29c49048af3bcf5eaf4a08b9b2ac2da, NAME => 'testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.tmp 2023-02-15 21:01:29,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 47ac5746381319486a87bab039f7dc73, disabling compactions & flushes 2023-02-15 21:01:29,271 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. after waiting 0 ms 2023-02-15 21:01:29,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,271 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:29,277 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,277 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a92a92f4d2fefe2acd5c29ba52247063, disabling compactions & flushes 2023-02-15 21:01:29,277 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,277 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,277 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. after waiting 0 ms 2023-02-15 21:01:29,277 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,277 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,277 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:29,279 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,279 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f29c49048af3bcf5eaf4a08b9b2ac2da, disabling compactions & flushes 2023-02-15 21:01:29,280 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,280 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,280 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. after waiting 0 ms 2023-02-15 21:01:29,280 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,280 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,280 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:29,283 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:29,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,284 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494889284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494889284"}]},"ts":"1676494889284"} 2023-02-15 21:01:29,289 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 21:01:29,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:29,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494889290"}]},"ts":"1676494889290"} 2023-02-15 21:01:29,292 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 21:01:29,296 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:29,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:29,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:29,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:29,308 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:29,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9b6caa699073c6abe425d26e7dc3518f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=29e99b3a6b63453a9e70481c093d51bf, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dc976705211f99d13495c680e21a1f7b, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=43fb4f5a4a4445bf6be71546c7897e99, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=618a9e646ce2cfbf1737008291010876, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=622d88e18bc49271e0c86cfefb4fd090, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b4a3bb5db3fb5bc1e1bdc8e6d23242ad, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=47ac5746381319486a87bab039f7dc73, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a92a92f4d2fefe2acd5c29ba52247063, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f29c49048af3bcf5eaf4a08b9b2ac2da, ASSIGN}] 2023-02-15 21:01:29,311 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=29e99b3a6b63453a9e70481c093d51bf, ASSIGN 2023-02-15 21:01:29,311 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9b6caa699073c6abe425d26e7dc3518f, ASSIGN 2023-02-15 21:01:29,312 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dc976705211f99d13495c680e21a1f7b, ASSIGN 2023-02-15 21:01:29,312 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=618a9e646ce2cfbf1737008291010876, ASSIGN 2023-02-15 21:01:29,312 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=29e99b3a6b63453a9e70481c093d51bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676494887582; forceNewPlan=false, retain=false 2023-02-15 21:01:29,313 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9b6caa699073c6abe425d26e7dc3518f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43709,1676494887624; forceNewPlan=false, retain=false 2023-02-15 21:01:29,313 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dc976705211f99d13495c680e21a1f7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676494887582; forceNewPlan=false, retain=false 2023-02-15 21:01:29,313 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=618a9e646ce2cfbf1737008291010876, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43709,1676494887624; forceNewPlan=false, retain=false 2023-02-15 21:01:29,314 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f29c49048af3bcf5eaf4a08b9b2ac2da, ASSIGN 2023-02-15 21:01:29,315 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a92a92f4d2fefe2acd5c29ba52247063, ASSIGN 2023-02-15 21:01:29,315 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f29c49048af3bcf5eaf4a08b9b2ac2da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43709,1676494887624; forceNewPlan=false, retain=false 2023-02-15 21:01:29,316 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b4a3bb5db3fb5bc1e1bdc8e6d23242ad, ASSIGN 2023-02-15 21:01:29,316 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=47ac5746381319486a87bab039f7dc73, ASSIGN 2023-02-15 21:01:29,317 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a92a92f4d2fefe2acd5c29ba52247063, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676494887582; forceNewPlan=false, retain=false 2023-02-15 21:01:29,317 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=622d88e18bc49271e0c86cfefb4fd090, ASSIGN 2023-02-15 21:01:29,317 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=47ac5746381319486a87bab039f7dc73, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43709,1676494887624; forceNewPlan=false, retain=false 2023-02-15 21:01:29,317 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=43fb4f5a4a4445bf6be71546c7897e99, ASSIGN 2023-02-15 21:01:29,317 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b4a3bb5db3fb5bc1e1bdc8e6d23242ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676494887582; forceNewPlan=false, retain=false 2023-02-15 21:01:29,318 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=622d88e18bc49271e0c86cfefb4fd090, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43709,1676494887624; forceNewPlan=false, retain=false 2023-02-15 21:01:29,319 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=43fb4f5a4a4445bf6be71546c7897e99, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33367,1676494887582; forceNewPlan=false, retain=false 2023-02-15 21:01:29,463 INFO [jenkins-hbase4:34955] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 21:01:29,467 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=618a9e646ce2cfbf1737008291010876, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,467 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=622d88e18bc49271e0c86cfefb4fd090, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,467 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9b6caa699073c6abe425d26e7dc3518f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,467 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=47ac5746381319486a87bab039f7dc73, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f29c49048af3bcf5eaf4a08b9b2ac2da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,467 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889467"}]},"ts":"1676494889467"} 2023-02-15 21:01:29,467 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494889467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889467"}]},"ts":"1676494889467"} 2023-02-15 21:01:29,468 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494889467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889467"}]},"ts":"1676494889467"} 2023-02-15 21:01:29,467 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889467"}]},"ts":"1676494889467"} 2023-02-15 21:01:29,467 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889467"}]},"ts":"1676494889467"} 2023-02-15 21:01:29,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 47ac5746381319486a87bab039f7dc73, server=jenkins-hbase4.apache.org,43709,1676494887624}] 2023-02-15 21:01:29,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure 9b6caa699073c6abe425d26e7dc3518f, server=jenkins-hbase4.apache.org,43709,1676494887624}] 2023-02-15 21:01:29,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure f29c49048af3bcf5eaf4a08b9b2ac2da, server=jenkins-hbase4.apache.org,43709,1676494887624}] 2023-02-15 21:01:29,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 622d88e18bc49271e0c86cfefb4fd090, server=jenkins-hbase4.apache.org,43709,1676494887624}] 2023-02-15 21:01:29,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 618a9e646ce2cfbf1737008291010876, server=jenkins-hbase4.apache.org,43709,1676494887624}] 2023-02-15 21:01:29,477 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a92a92f4d2fefe2acd5c29ba52247063, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,477 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889477"}]},"ts":"1676494889477"} 2023-02-15 21:01:29,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure a92a92f4d2fefe2acd5c29ba52247063, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:29,483 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=29e99b3a6b63453a9e70481c093d51bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889482"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889482"}]},"ts":"1676494889482"} 2023-02-15 21:01:29,483 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=dc976705211f99d13495c680e21a1f7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,483 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889483"}]},"ts":"1676494889483"} 2023-02-15 21:01:29,485 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=43fb4f5a4a4445bf6be71546c7897e99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,485 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889484"}]},"ts":"1676494889484"} 2023-02-15 21:01:29,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b4a3bb5db3fb5bc1e1bdc8e6d23242ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494889485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494889485"}]},"ts":"1676494889485"} 2023-02-15 21:01:29,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 29e99b3a6b63453a9e70481c093d51bf, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:29,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure dc976705211f99d13495c680e21a1f7b, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:29,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 43fb4f5a4a4445bf6be71546c7897e99, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:29,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure b4a3bb5db3fb5bc1e1bdc8e6d23242ad, server=jenkins-hbase4.apache.org,33367,1676494887582}] 2023-02-15 21:01:29,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:29,623 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,623 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:29,627 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:29,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9b6caa699073c6abe425d26e7dc3518f, NAME => 'testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 21:01:29,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,632 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,634 DEBUG [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/f1 2023-02-15 21:01:29,634 DEBUG [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/f1 2023-02-15 21:01:29,634 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6caa699073c6abe425d26e7dc3518f columnFamilyName f1 2023-02-15 21:01:29,635 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(310): Store=9b6caa699073c6abe425d26e7dc3518f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,635 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,637 DEBUG [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/f2 2023-02-15 21:01:29,637 DEBUG [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/f2 2023-02-15 21:01:29,637 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6caa699073c6abe425d26e7dc3518f columnFamilyName f2 2023-02-15 21:01:29,638 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(310): Store=9b6caa699073c6abe425d26e7dc3518f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 29e99b3a6b63453a9e70481c093d51bf, NAME => 'testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 21:01:29,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,640 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,641 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1 2023-02-15 21:01:29,641 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1 2023-02-15 21:01:29,642 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29e99b3a6b63453a9e70481c093d51bf columnFamilyName f1 2023-02-15 21:01:29,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:29,642 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(310): Store=29e99b3a6b63453a9e70481c093d51bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,642 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,644 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2 2023-02-15 21:01:29,644 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2 2023-02-15 21:01:29,644 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29e99b3a6b63453a9e70481c093d51bf columnFamilyName f2 2023-02-15 21:01:29,645 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(310): Store=29e99b3a6b63453a9e70481c093d51bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9b6caa699073c6abe425d26e7dc3518f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59412966, jitterRate=-0.11467781662940979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:29,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f., pid=22, masterSystemTime=1676494889623 2023-02-15 21:01:29,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:29,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 618a9e646ce2cfbf1737008291010876, NAME => 'testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 21:01:29,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9b6caa699073c6abe425d26e7dc3518f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,653 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494889653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889653"}]},"ts":"1676494889653"} 2023-02-15 21:01:29,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:29,655 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 29e99b3a6b63453a9e70481c093d51bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74329590, jitterRate=0.10759720206260681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:29,657 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1 2023-02-15 21:01:29,657 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1 2023-02-15 21:01:29,657 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618a9e646ce2cfbf1737008291010876 columnFamilyName f1 2023-02-15 21:01:29,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf., pid=27, masterSystemTime=1676494889635 2023-02-15 21:01:29,658 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(310): Store=618a9e646ce2cfbf1737008291010876/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,658 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:29,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a92a92f4d2fefe2acd5c29ba52247063, NAME => 'testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 21:01:29,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,660 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=29e99b3a6b63453a9e70481c093d51bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,660 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889660"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889660"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889660"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889660"}]},"ts":"1676494889660"} 2023-02-15 21:01:29,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,662 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2 2023-02-15 21:01:29,662 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2 2023-02-15 21:01:29,662 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,662 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618a9e646ce2cfbf1737008291010876 columnFamilyName f2 2023-02-15 21:01:29,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-15 21:01:29,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure 9b6caa699073c6abe425d26e7dc3518f, server=jenkins-hbase4.apache.org,43709,1676494887624 in 189 msec 2023-02-15 21:01:29,663 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(310): Store=618a9e646ce2cfbf1737008291010876/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,667 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1 2023-02-15 21:01:29,667 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1 2023-02-15 21:01:29,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:29,667 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a92a92f4d2fefe2acd5c29ba52247063 columnFamilyName f1 2023-02-15 21:01:29,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-15 21:01:29,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 29e99b3a6b63453a9e70481c093d51bf, server=jenkins-hbase4.apache.org,33367,1676494887582 in 177 msec 2023-02-15 21:01:29,668 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(310): Store=a92a92f4d2fefe2acd5c29ba52247063/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9b6caa699073c6abe425d26e7dc3518f, ASSIGN in 354 msec 2023-02-15 21:01:29,668 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=29e99b3a6b63453a9e70481c093d51bf, ASSIGN in 360 msec 2023-02-15 21:01:29,669 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2 2023-02-15 21:01:29,669 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2 2023-02-15 21:01:29,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,670 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a92a92f4d2fefe2acd5c29ba52247063 columnFamilyName f2 2023-02-15 21:01:29,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 618a9e646ce2cfbf1737008291010876; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66965405, jitterRate=-0.002137705683708191}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:29,670 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(310): Store=a92a92f4d2fefe2acd5c29ba52247063/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876., pid=25, masterSystemTime=1676494889623 2023-02-15 21:01:29,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:29,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 47ac5746381319486a87bab039f7dc73, NAME => 'testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 21:01:29,673 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=618a9e646ce2cfbf1737008291010876, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,673 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889673"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889673"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889673"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889673"}]},"ts":"1676494889673"} 2023-02-15 21:01:29,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,674 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:29,676 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1 2023-02-15 21:01:29,676 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1 2023-02-15 21:01:29,676 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47ac5746381319486a87bab039f7dc73 columnFamilyName f1 2023-02-15 21:01:29,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-15 21:01:29,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 618a9e646ce2cfbf1737008291010876, server=jenkins-hbase4.apache.org,43709,1676494887624 in 198 msec 2023-02-15 21:01:29,677 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(310): Store=47ac5746381319486a87bab039f7dc73/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,677 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=618a9e646ce2cfbf1737008291010876, ASSIGN in 368 msec 2023-02-15 21:01:29,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a92a92f4d2fefe2acd5c29ba52247063; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70863366, jitterRate=0.05594643950462341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:29,678 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2 2023-02-15 21:01:29,678 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2 2023-02-15 21:01:29,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063., pid=26, masterSystemTime=1676494889635 2023-02-15 21:01:29,678 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47ac5746381319486a87bab039f7dc73 columnFamilyName f2 2023-02-15 21:01:29,679 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(310): Store=47ac5746381319486a87bab039f7dc73/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:29,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dc976705211f99d13495c680e21a1f7b, NAME => 'testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 21:01:29,680 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a92a92f4d2fefe2acd5c29ba52247063, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,680 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889680"}]},"ts":"1676494889680"} 2023-02-15 21:01:29,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,682 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-15 21:01:29,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure a92a92f4d2fefe2acd5c29ba52247063, server=jenkins-hbase4.apache.org,33367,1676494887582 in 202 msec 2023-02-15 21:01:29,684 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1 2023-02-15 21:01:29,684 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1 2023-02-15 21:01:29,684 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc976705211f99d13495c680e21a1f7b columnFamilyName f1 2023-02-15 21:01:29,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:29,685 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(310): Store=dc976705211f99d13495c680e21a1f7b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a92a92f4d2fefe2acd5c29ba52247063, ASSIGN in 376 msec 2023-02-15 21:01:29,685 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,687 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2 2023-02-15 21:01:29,687 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2 2023-02-15 21:01:29,687 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc976705211f99d13495c680e21a1f7b columnFamilyName f2 2023-02-15 21:01:29,687 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(310): Store=dc976705211f99d13495c680e21a1f7b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 47ac5746381319486a87bab039f7dc73; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61927225, jitterRate=-0.07721243798732758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:29,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73., pid=21, masterSystemTime=1676494889623 2023-02-15 21:01:29,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,696 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=47ac5746381319486a87bab039f7dc73, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,696 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889696"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889696"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889696"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889696"}]},"ts":"1676494889696"} 2023-02-15 21:01:29,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:29,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:29,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f29c49048af3bcf5eaf4a08b9b2ac2da, NAME => 'testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 21:01:29,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-15 21:01:29,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 47ac5746381319486a87bab039f7dc73, server=jenkins-hbase4.apache.org,43709,1676494887624 in 228 msec 2023-02-15 21:01:29,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=47ac5746381319486a87bab039f7dc73, ASSIGN in 392 msec 2023-02-15 21:01:29,705 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dc976705211f99d13495c680e21a1f7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74463597, jitterRate=0.10959406197071075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:29,707 DEBUG [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/f1 2023-02-15 21:01:29,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b., pid=28, masterSystemTime=1676494889635 2023-02-15 21:01:29,707 DEBUG [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/f1 2023-02-15 21:01:29,708 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f29c49048af3bcf5eaf4a08b9b2ac2da columnFamilyName f1 2023-02-15 21:01:29,708 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(310): Store=f29c49048af3bcf5eaf4a08b9b2ac2da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,708 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,710 DEBUG [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/f2 2023-02-15 21:01:29,710 DEBUG [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/f2 2023-02-15 21:01:29,710 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f29c49048af3bcf5eaf4a08b9b2ac2da columnFamilyName f2 2023-02-15 21:01:29,711 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(310): Store=f29c49048af3bcf5eaf4a08b9b2ac2da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:29,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:29,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 43fb4f5a4a4445bf6be71546c7897e99, NAME => 'testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 21:01:29,718 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=dc976705211f99d13495c680e21a1f7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,718 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889718"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889718"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889718"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889718"}]},"ts":"1676494889718"} 2023-02-15 21:01:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f29c49048af3bcf5eaf4a08b9b2ac2da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60576170, jitterRate=-0.09734472632408142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:29,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da., pid=23, masterSystemTime=1676494889623 2023-02-15 21:01:29,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:29,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 622d88e18bc49271e0c86cfefb4fd090, NAME => 'testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 21:01:29,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-15 21:01:29,724 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f29c49048af3bcf5eaf4a08b9b2ac2da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,724 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676494889724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889724"}]},"ts":"1676494889724"} 2023-02-15 21:01:29,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure dc976705211f99d13495c680e21a1f7b, server=jenkins-hbase4.apache.org,33367,1676494887582 in 234 msec 2023-02-15 21:01:29,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dc976705211f99d13495c680e21a1f7b, ASSIGN in 416 msec 2023-02-15 21:01:29,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,728 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-15 21:01:29,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure f29c49048af3bcf5eaf4a08b9b2ac2da, server=jenkins-hbase4.apache.org,43709,1676494887624 in 254 msec 2023-02-15 21:01:29,729 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f29c49048af3bcf5eaf4a08b9b2ac2da, ASSIGN in 421 msec 2023-02-15 21:01:29,730 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1 2023-02-15 21:01:29,730 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1 2023-02-15 21:01:29,731 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43fb4f5a4a4445bf6be71546c7897e99 columnFamilyName f1 2023-02-15 21:01:29,731 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1 2023-02-15 21:01:29,731 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1 2023-02-15 21:01:29,731 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(310): Store=43fb4f5a4a4445bf6be71546c7897e99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,731 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d88e18bc49271e0c86cfefb4fd090 columnFamilyName f1 2023-02-15 21:01:29,731 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,732 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(310): Store=622d88e18bc49271e0c86cfefb4fd090/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,732 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,733 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2 2023-02-15 21:01:29,733 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2 2023-02-15 21:01:29,733 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43fb4f5a4a4445bf6be71546c7897e99 columnFamilyName f2 2023-02-15 21:01:29,733 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2 2023-02-15 21:01:29,734 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2 2023-02-15 21:01:29,734 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(310): Store=43fb4f5a4a4445bf6be71546c7897e99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,734 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d88e18bc49271e0c86cfefb4fd090 columnFamilyName f2 2023-02-15 21:01:29,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,735 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(310): Store=622d88e18bc49271e0c86cfefb4fd090/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:29,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 43fb4f5a4a4445bf6be71546c7897e99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64549835, jitterRate=-0.038132503628730774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:29,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 622d88e18bc49271e0c86cfefb4fd090; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66604078, jitterRate=-0.007521897554397583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:29,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99., pid=29, masterSystemTime=1676494889635 2023-02-15 21:01:29,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090., pid=24, masterSystemTime=1676494889623 2023-02-15 21:01:29,745 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=43fb4f5a4a4445bf6be71546c7897e99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,745 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889745"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889745"}]},"ts":"1676494889745"} 2023-02-15 21:01:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:29,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b4a3bb5db3fb5bc1e1bdc8e6d23242ad, NAME => 'testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 21:01:29,747 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=622d88e18bc49271e0c86cfefb4fd090, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:29,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:29,748 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889747"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889747"}]},"ts":"1676494889747"} 2023-02-15 21:01:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-15 21:01:29,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 43fb4f5a4a4445bf6be71546c7897e99, server=jenkins-hbase4.apache.org,33367,1676494887582 in 260 msec 2023-02-15 21:01:29,750 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=43fb4f5a4a4445bf6be71546c7897e99, ASSIGN in 441 msec 2023-02-15 21:01:29,751 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1 2023-02-15 21:01:29,752 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1 2023-02-15 21:01:29,752 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4a3bb5db3fb5bc1e1bdc8e6d23242ad columnFamilyName f1 2023-02-15 21:01:29,753 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(310): Store=b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,753 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,754 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2 2023-02-15 21:01:29,754 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2 2023-02-15 21:01:29,755 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4a3bb5db3fb5bc1e1bdc8e6d23242ad columnFamilyName f2 2023-02-15 21:01:29,755 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(310): Store=b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:29,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-15 21:01:29,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 622d88e18bc49271e0c86cfefb4fd090, server=jenkins-hbase4.apache.org,43709,1676494887624 in 278 msec 2023-02-15 21:01:29,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=622d88e18bc49271e0c86cfefb4fd090, ASSIGN in 449 msec 2023-02-15 21:01:29,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:29,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:29,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:29,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b4a3bb5db3fb5bc1e1bdc8e6d23242ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65578180, jitterRate=-0.022808969020843506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:29,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad., pid=30, masterSystemTime=1676494889635 2023-02-15 21:01:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:29,766 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b4a3bb5db3fb5bc1e1bdc8e6d23242ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:29,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676494889766"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494889766"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494889766"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494889766"}]},"ts":"1676494889766"} 2023-02-15 21:01:29,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-15 21:01:29,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure b4a3bb5db3fb5bc1e1bdc8e6d23242ad, server=jenkins-hbase4.apache.org,33367,1676494887582 in 280 msec 2023-02-15 21:01:29,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-15 21:01:29,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b4a3bb5db3fb5bc1e1bdc8e6d23242ad, ASSIGN in 461 msec 2023-02-15 21:01:29,772 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:29,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494889772"}]},"ts":"1676494889772"} 2023-02-15 21:01:29,773 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 21:01:29,776 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:29,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 787 msec 2023-02-15 21:01:30,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:30,102 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 21:01:30,102 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 21:01:30,102 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:30,107 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 21:01:30,107 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:30,108 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 21:01:30,108 INFO [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:30,162 DEBUG [hconnection-0x787a932e-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:30,179 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48948, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:30,186 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43709] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:30,197 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33367] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:30,314 INFO [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:30,314 INFO [Listener at localhost/33425] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:30,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:30,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494890315 (current time:1676494890315). 2023-02-15 21:01:30,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:30,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] zookeeper.ReadOnlyZKClient(139): Connect 0x449671f3 to 127.0.0.1:55483 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:30,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f7b711b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:30,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:30,327 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:30,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x449671f3 to 127.0.0.1:55483 2023-02-15 21:01:30,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:30,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:30,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:30,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:30,332 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:30,332 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676495490332 2023-02-15 21:01:30,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:30,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 21:01:30,333 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:30,334 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:30,334 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:30,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:30,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-15 21:01:30,335 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:30,336 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676495490336 2023-02-15 21:01:30,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,352 INFO [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-15 21:01:30,352 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:30,353 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-15 21:01:30,353 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-15 21:01:30,353 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,353 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,356 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:30,356 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:30,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:30,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:30,356 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:30,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,357 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,357 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,357 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,358 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-15 21:01:30,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,364 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 21:01:30,364 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:30,364 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33367,1676494887582' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 21:01:30,365 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43709,1676494887624' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-15 21:01:30,367 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,367 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,367 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:30,367 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:30,368 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,368 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:30,368 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,368 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43709,1676494887624' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b5dc659[Count = 1] remaining members to acquire global barrier 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33367,1676494887582' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-15 21:01:30,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b5dc659[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:30,372 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-15 21:01:30,372 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,374 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:30,374 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:30,374 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,374 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:30,374 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. started... 2023-02-15 21:01:30,375 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,375 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:30,376 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:30,377 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:30,377 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. started... 2023-02-15 21:01:30,377 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:30,377 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. started... 2023-02-15 21:01:30,380 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 29e99b3a6b63453a9e70481c093d51bf 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 21:01:30,380 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 618a9e646ce2cfbf1737008291010876 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:30,384 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 21:01:30,384 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:30,385 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:30,385 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. started... 2023-02-15 21:01:30,385 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:30,385 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. started... 2023-02-15 21:01:30,388 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 21:01:30,389 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:30,389 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:30,389 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 43fb4f5a4a4445bf6be71546c7897e99 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:30,389 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,389 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,389 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:30,389 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:30,389 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:30,390 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. started... 2023-02-15 21:01:30,398 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:30,398 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,399 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,399 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:30,399 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:30,434 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:30,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:30,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:30,443 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f1/2326489b7646410faa7768983274ef0f 2023-02-15 21:01:30,444 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:30,461 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f1/872b3c6091aa4f2d9acb7bd57a6a4068 2023-02-15 21:01:30,480 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f1/afb9dd554da747ad81dc86990dfe7425 2023-02-15 21:01:30,488 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f1/1ed1ea379e6c4985903972f2d5eb9847 2023-02-15 21:01:30,500 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. completed. 2023-02-15 21:01:30,500 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:30,500 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 21:01:30,500 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. started... 2023-02-15 21:01:30,518 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 47ac5746381319486a87bab039f7dc73 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:30,520 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f2/11b0e2b205634220bd8fb4b6a668ab7d 2023-02-15 21:01:30,528 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f2/7aa186984d084ce4be313ea6404574ae 2023-02-15 21:01:30,530 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f1/2326489b7646410faa7768983274ef0f as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/2326489b7646410faa7768983274ef0f 2023-02-15 21:01:30,540 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/2326489b7646410faa7768983274ef0f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,543 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f2/7da26467cac44c47992c6b3857226daf 2023-02-15 21:01:30,543 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f2/11b0e2b205634220bd8fb4b6a668ab7d as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/11b0e2b205634220bd8fb4b6a668ab7d 2023-02-15 21:01:30,546 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f1/872b3c6091aa4f2d9acb7bd57a6a4068 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/872b3c6091aa4f2d9acb7bd57a6a4068 2023-02-15 21:01:30,550 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/11b0e2b205634220bd8fb4b6a668ab7d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,551 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f1/1ed1ea379e6c4985903972f2d5eb9847 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/1ed1ea379e6c4985903972f2d5eb9847 2023-02-15 21:01:30,552 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b4a3bb5db3fb5bc1e1bdc8e6d23242ad in 176ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,552 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-15 21:01:30,552 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:30,553 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,553 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,553 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/2326489b7646410faa7768983274ef0f] hfiles 2023-02-15 21:01:30,553 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/2326489b7646410faa7768983274ef0f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,553 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/11b0e2b205634220bd8fb4b6a668ab7d] hfiles 2023-02-15 21:01:30,553 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/11b0e2b205634220bd8fb4b6a668ab7d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,561 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/872b3c6091aa4f2d9acb7bd57a6a4068, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:30,562 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f2/7aa186984d084ce4be313ea6404574ae as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/7aa186984d084ce4be313ea6404574ae 2023-02-15 21:01:30,572 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/1ed1ea379e6c4985903972f2d5eb9847, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,573 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f2/7da26467cac44c47992c6b3857226daf as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/7da26467cac44c47992c6b3857226daf 2023-02-15 21:01:30,574 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/7aa186984d084ce4be313ea6404574ae, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:30,574 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f1/613c373cfc0c434abd9443ca48d66753 2023-02-15 21:01:30,575 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 29e99b3a6b63453a9e70481c093d51bf in 195ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/872b3c6091aa4f2d9acb7bd57a6a4068] hfiles 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/872b3c6091aa4f2d9acb7bd57a6a4068 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/7aa186984d084ce4be313ea6404574ae] hfiles 2023-02-15 21:01:30,576 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/7aa186984d084ce4be313ea6404574ae for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,586 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/7da26467cac44c47992c6b3857226daf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,587 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 618a9e646ce2cfbf1737008291010876 in 207ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/1ed1ea379e6c4985903972f2d5eb9847] hfiles 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/1ed1ea379e6c4985903972f2d5eb9847 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/7da26467cac44c47992c6b3857226daf] hfiles 2023-02-15 21:01:30,587 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/7da26467cac44c47992c6b3857226daf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,599 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. completed. 2023-02-15 21:01:30,599 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:30,599 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:30,599 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 21:01:30,599 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. started... 2023-02-15 21:01:30,599 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dc976705211f99d13495c680e21a1f7b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:30,617 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. completed. 2023-02-15 21:01:30,617 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:30,617 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:30,617 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. started... 2023-02-15 21:01:30,617 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a92a92f4d2fefe2acd5c29ba52247063 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 21:01:30,617 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 21:01:30,632 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. completed. 2023-02-15 21:01:30,632 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:30,632 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:30,632 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. started... 2023-02-15 21:01:30,632 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 622d88e18bc49271e0c86cfefb4fd090 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:30,632 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 21:01:30,644 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:30,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:30,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:30,646 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 21:01:30,648 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f2/ed3979b38f7d4776b7e0075d1fbc85a0 2023-02-15 21:01:30,648 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f1/0ba06ab7af184b96a56b1bf926585f87 2023-02-15 21:01:30,657 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f1/613c373cfc0c434abd9443ca48d66753 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/613c373cfc0c434abd9443ca48d66753 2023-02-15 21:01:30,663 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/613c373cfc0c434abd9443ca48d66753, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,664 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f2/ed3979b38f7d4776b7e0075d1fbc85a0 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/ed3979b38f7d4776b7e0075d1fbc85a0 2023-02-15 21:01:30,669 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/ed3979b38f7d4776b7e0075d1fbc85a0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,670 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 47ac5746381319486a87bab039f7dc73 in 152ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/613c373cfc0c434abd9443ca48d66753] hfiles 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/613c373cfc0c434abd9443ca48d66753 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/ed3979b38f7d4776b7e0075d1fbc85a0] hfiles 2023-02-15 21:01:30,670 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/ed3979b38f7d4776b7e0075d1fbc85a0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,682 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f1/b18979b92cbc49ee971bf819ffd22cfa 2023-02-15 21:01:30,686 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f1/a8ce56f6f726475796c97c808bef86c4 2023-02-15 21:01:30,696 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f2/d771ad24726d4832b5eac2e72e9bb62a 2023-02-15 21:01:30,702 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f1/0ba06ab7af184b96a56b1bf926585f87 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/0ba06ab7af184b96a56b1bf926585f87 2023-02-15 21:01:30,709 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/0ba06ab7af184b96a56b1bf926585f87, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,710 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f2/d771ad24726d4832b5eac2e72e9bb62a as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/d771ad24726d4832b5eac2e72e9bb62a 2023-02-15 21:01:30,716 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. completed. 2023-02-15 21:01:30,716 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:30,716 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 21:01:30,719 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/d771ad24726d4832b5eac2e72e9bb62a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,720 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for dc976705211f99d13495c680e21a1f7b in 121ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/0ba06ab7af184b96a56b1bf926585f87] hfiles 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/0ba06ab7af184b96a56b1bf926585f87 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/d771ad24726d4832b5eac2e72e9bb62a] hfiles 2023-02-15 21:01:30,721 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/d771ad24726d4832b5eac2e72e9bb62a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,728 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f2/bd0d67976f6f4b39b1c431f922d3b422 2023-02-15 21:01:30,740 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f2/d5aac87bf7684813a48f6adcdd3cba6c 2023-02-15 21:01:30,742 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f1/b18979b92cbc49ee971bf819ffd22cfa as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/b18979b92cbc49ee971bf819ffd22cfa 2023-02-15 21:01:30,748 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f1/a8ce56f6f726475796c97c808bef86c4 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/a8ce56f6f726475796c97c808bef86c4 2023-02-15 21:01:30,752 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/b18979b92cbc49ee971bf819ffd22cfa, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:30,756 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f2/bd0d67976f6f4b39b1c431f922d3b422 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/bd0d67976f6f4b39b1c431f922d3b422 2023-02-15 21:01:30,763 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/a8ce56f6f726475796c97c808bef86c4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,764 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f2/d5aac87bf7684813a48f6adcdd3cba6c as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/d5aac87bf7684813a48f6adcdd3cba6c 2023-02-15 21:01:30,769 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. completed. 2023-02-15 21:01:30,769 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:30,769 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 21:01:30,773 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/bd0d67976f6f4b39b1c431f922d3b422, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:30,774 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for a92a92f4d2fefe2acd5c29ba52247063 in 157ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,774 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:30,774 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,774 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,774 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/b18979b92cbc49ee971bf819ffd22cfa] hfiles 2023-02-15 21:01:30,774 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/b18979b92cbc49ee971bf819ffd22cfa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,775 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/bd0d67976f6f4b39b1c431f922d3b422] hfiles 2023-02-15 21:01:30,775 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/bd0d67976f6f4b39b1c431f922d3b422 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,781 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/d5aac87bf7684813a48f6adcdd3cba6c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,782 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 622d88e18bc49271e0c86cfefb4fd090 in 150ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,782 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:30,782 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,782 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,782 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/a8ce56f6f726475796c97c808bef86c4] hfiles 2023-02-15 21:01:30,782 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/a8ce56f6f726475796c97c808bef86c4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,783 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/d5aac87bf7684813a48f6adcdd3cba6c] hfiles 2023-02-15 21:01:30,783 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/d5aac87bf7684813a48f6adcdd3cba6c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,791 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. completed. 2023-02-15 21:01:30,791 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:30,791 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 21:01:30,797 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. completed. 2023-02-15 21:01:30,797 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:30,797 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 21:01:30,869 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. completed. 2023-02-15 21:01:30,869 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 21:01:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 21:01:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 21:01:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,43709,1676494887624' in zk 2023-02-15 21:01:30,871 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 21:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 21:01:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,43709,1676494887624': 2023-02-15 21:01:30,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43709,1676494887624' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 21:01:30,944 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f2/ac31086dc6e64462bc5de8a168143665 2023-02-15 21:01:30,946 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:30,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:30,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:30,948 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 21:01:30,950 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f1/afb9dd554da747ad81dc86990dfe7425 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/afb9dd554da747ad81dc86990dfe7425 2023-02-15 21:01:30,956 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/afb9dd554da747ad81dc86990dfe7425, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,957 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f2/ac31086dc6e64462bc5de8a168143665 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/ac31086dc6e64462bc5de8a168143665 2023-02-15 21:01:30,962 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/ac31086dc6e64462bc5de8a168143665, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:30,963 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 43fb4f5a4a4445bf6be71546c7897e99 in 574ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:30,963 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:30,964 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,964 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:30,964 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/afb9dd554da747ad81dc86990dfe7425] hfiles 2023-02-15 21:01:30,964 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/afb9dd554da747ad81dc86990dfe7425 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,964 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/ac31086dc6e64462bc5de8a168143665] hfiles 2023-02-15 21:01:30,964 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/ac31086dc6e64462bc5de8a168143665 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,977 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. completed. 2023-02-15 21:01:30,977 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 21:01:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 21:01:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-15 21:01:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,33367,1676494887582' in zk 2023-02-15 21:01:30,980 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,980 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-15 21:01:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:30,980 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:30,980 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-15 21:01:30,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:30,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:30,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,33367,1676494887582': 2023-02-15 21:01:30,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33367,1676494887582' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:30,984 INFO [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-15 21:01:30,984 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:30,984 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:30,984 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,984 INFO [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:30,986 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:30,986 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:30,986 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:30,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:30,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:30,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:30,987 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,988 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:30,990 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,990 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,996 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,996 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:30,996 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:30,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:30,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:30,996 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:30,996 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:30,996 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,997 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,997 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:30,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,997 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,998 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:30,998 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,998 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:30,998 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,999 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:30,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:30,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:31,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:31,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:31,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-15 21:01:31,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:31,306 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:31,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676494890333Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676494890998 (+665 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676494890998Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676494891260 (+262 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676494891270 (+10 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676494891305 (+35 ms) 2023-02-15 21:01:31,308 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:31,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 975 msec 2023-02-15 21:01:31,449 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:31,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:31,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:31,451 INFO [Listener at localhost/33425] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:31,456 INFO [Listener at localhost/33425] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:31,464 INFO [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:31,510 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43709] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:31,522 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33367] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:31,608 INFO [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:31,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:31,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 21:01:31,617 INFO [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 21:01:31,617 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:31,618 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 21:01:31,618 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 21:01:31,619 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:31,619 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:31,620 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:31,620 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:31,620 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:31,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:31,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:31,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:31,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:31,621 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:31,621 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:31,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:31,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:31,621 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:31,621 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:31,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:31,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 21:01:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 21:01:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:31,622 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 21:01:31,623 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 21:01:31,623 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:31,624 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 21:01:31,624 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:31,625 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. started... 2023-02-15 21:01:31,625 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:31,628 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:31,628 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. started... 2023-02-15 21:01:31,628 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 29e99b3a6b63453a9e70481c093d51bf 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 21:01:31,633 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 21:01:31,633 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:31,633 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. started... 2023-02-15 21:01:31,633 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. started... 2023-02-15 21:01:31,633 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 618a9e646ce2cfbf1737008291010876 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:31,633 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 43fb4f5a4a4445bf6be71546c7897e99 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:31,636 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:31,636 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. started... 2023-02-15 21:01:31,636 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:31,636 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:31,641 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. started... 2023-02-15 21:01:31,641 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:31,641 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. started... 2023-02-15 21:01:31,641 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 47ac5746381319486a87bab039f7dc73 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:31,641 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. started... 2023-02-15 21:01:31,641 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 622d88e18bc49271e0c86cfefb4fd090 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:31,641 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 21:01:31,680 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f1/8aed0057ec00496aa69825db4ceabb34 2023-02-15 21:01:31,696 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f1/32be7ff2848e45328ffbc717889fbef6 2023-02-15 21:01:31,708 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f1/94161c01f2574050bafc587cbe7a52eb 2023-02-15 21:01:31,708 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f1/a8cb9e4c7cab4a928257e8f8e82c87c8 2023-02-15 21:01:31,722 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f1/f77937191a9041d1a329d40aa84afceb 2023-02-15 21:01:31,749 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f2/9c36d021c38043a98f44e7972dd9a0c2 2023-02-15 21:01:31,757 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f1/a8cb9e4c7cab4a928257e8f8e82c87c8 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/a8cb9e4c7cab4a928257e8f8e82c87c8 2023-02-15 21:01:31,760 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f2/0f5b9b76b0404df3a2fa63f33574d2dd 2023-02-15 21:01:31,762 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/a8cb9e4c7cab4a928257e8f8e82c87c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,763 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/.tmp/f2/9c36d021c38043a98f44e7972dd9a0c2 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/9c36d021c38043a98f44e7972dd9a0c2 2023-02-15 21:01:31,765 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f2/745bd5367c254005913cb1e764e8ef3c 2023-02-15 21:01:31,766 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f1/32be7ff2848e45328ffbc717889fbef6 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/32be7ff2848e45328ffbc717889fbef6 2023-02-15 21:01:31,769 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/9c36d021c38043a98f44e7972dd9a0c2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,770 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 43fb4f5a4a4445bf6be71546c7897e99 in 137ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:31,770 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:31,770 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:31,770 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:31,770 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 21:01:31,770 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. started... 2023-02-15 21:01:31,770 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dc976705211f99d13495c680e21a1f7b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:31,770 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f1/f77937191a9041d1a329d40aa84afceb as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/f77937191a9041d1a329d40aa84afceb 2023-02-15 21:01:31,775 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/32be7ff2848e45328ffbc717889fbef6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,776 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/.tmp/f2/0f5b9b76b0404df3a2fa63f33574d2dd as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/0f5b9b76b0404df3a2fa63f33574d2dd 2023-02-15 21:01:31,781 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/f77937191a9041d1a329d40aa84afceb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,782 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/0f5b9b76b0404df3a2fa63f33574d2dd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,782 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/.tmp/f2/745bd5367c254005913cb1e764e8ef3c as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/745bd5367c254005913cb1e764e8ef3c 2023-02-15 21:01:31,783 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 618a9e646ce2cfbf1737008291010876 in 150ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:31,783 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:31,783 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:31,783 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 21:01:31,787 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/745bd5367c254005913cb1e764e8ef3c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,788 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 47ac5746381319486a87bab039f7dc73 in 147ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:31,788 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:31,788 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:31,788 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 21:01:31,795 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f1/c3ae8a02a49540ffa9dafa99919a6bd9 2023-02-15 21:01:31,811 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f2/419eea88eda24d498e428a195ec64d54 2023-02-15 21:01:31,817 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f1/c3ae8a02a49540ffa9dafa99919a6bd9 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/c3ae8a02a49540ffa9dafa99919a6bd9 2023-02-15 21:01:31,822 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/c3ae8a02a49540ffa9dafa99919a6bd9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,823 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/.tmp/f2/419eea88eda24d498e428a195ec64d54 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/419eea88eda24d498e428a195ec64d54 2023-02-15 21:01:31,827 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/419eea88eda24d498e428a195ec64d54, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:31,828 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for dc976705211f99d13495c680e21a1f7b in 58ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:31,829 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:31,829 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:31,829 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:31,829 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 21:01:31,829 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. started... 2023-02-15 21:01:31,829 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a92a92f4d2fefe2acd5c29ba52247063 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 21:01:31,841 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f1/deb603c459c24072baf6d56c19bb599e 2023-02-15 21:01:31,858 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f2/75adb93d8a2c4667933cf5ac5afb6cf9 2023-02-15 21:01:31,864 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f1/deb603c459c24072baf6d56c19bb599e as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/deb603c459c24072baf6d56c19bb599e 2023-02-15 21:01:31,869 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/deb603c459c24072baf6d56c19bb599e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:31,870 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/.tmp/f2/75adb93d8a2c4667933cf5ac5afb6cf9 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/75adb93d8a2c4667933cf5ac5afb6cf9 2023-02-15 21:01:31,875 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/75adb93d8a2c4667933cf5ac5afb6cf9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:31,876 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for a92a92f4d2fefe2acd5c29ba52247063 in 47ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:31,876 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:31,876 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:31,876 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 21:01:32,084 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f1/e8182fde4f6c4ec79e457c47f8f910fd 2023-02-15 21:01:32,097 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f2/3953a55534c74fc5ad9a7e9017d09c46 2023-02-15 21:01:32,101 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f1/e8182fde4f6c4ec79e457c47f8f910fd as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/e8182fde4f6c4ec79e457c47f8f910fd 2023-02-15 21:01:32,106 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/e8182fde4f6c4ec79e457c47f8f910fd, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:32,107 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/.tmp/f2/3953a55534c74fc5ad9a7e9017d09c46 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/3953a55534c74fc5ad9a7e9017d09c46 2023-02-15 21:01:32,111 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/3953a55534c74fc5ad9a7e9017d09c46, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:32,112 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 29e99b3a6b63453a9e70481c093d51bf in 484ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:32,112 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:32,112 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:32,113 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 21:01:32,145 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f2/b30a019de7c64a4794bd0448e6da8934 2023-02-15 21:01:32,147 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f2/2c054576736044b7a39302e7aa15dff0 2023-02-15 21:01:32,151 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f1/94161c01f2574050bafc587cbe7a52eb as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/94161c01f2574050bafc587cbe7a52eb 2023-02-15 21:01:32,152 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f1/8aed0057ec00496aa69825db4ceabb34 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/8aed0057ec00496aa69825db4ceabb34 2023-02-15 21:01:32,156 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/94161c01f2574050bafc587cbe7a52eb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:32,156 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/8aed0057ec00496aa69825db4ceabb34, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:32,157 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/.tmp/f2/b30a019de7c64a4794bd0448e6da8934 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/b30a019de7c64a4794bd0448e6da8934 2023-02-15 21:01:32,157 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/.tmp/f2/2c054576736044b7a39302e7aa15dff0 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/2c054576736044b7a39302e7aa15dff0 2023-02-15 21:01:32,162 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/b30a019de7c64a4794bd0448e6da8934, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:32,162 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/2c054576736044b7a39302e7aa15dff0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:32,163 INFO [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 622d88e18bc49271e0c86cfefb4fd090 in 522ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:32,163 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:32,163 DEBUG [rs(jenkins-hbase4.apache.org,43709,1676494887624)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 21:01:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 21:01:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 21:01:32,163 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43709,1676494887624' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 21:01:32,164 INFO [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b4a3bb5db3fb5bc1e1bdc8e6d23242ad in 539ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:32,164 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:32,164 DEBUG [rs(jenkins-hbase4.apache.org,33367,1676494887582)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:32,164 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 21:01:32,164 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 21:01:32,164 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,164 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 21:01:32,164 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33367,1676494887582' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 21:01:32,165 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,165 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:32,167 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,167 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:32,167 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,167 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:32,167 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,167 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43709,1676494887624' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f624fea[Count = 1] remaining members to acquire global barrier 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:32,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:32,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33367,1676494887582' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 21:01:32,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f624fea[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:32,171 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 21:01:32,171 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 21:01:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 21:01:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 21:01:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43709,1676494887624' in zk 2023-02-15 21:01:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 21:01:32,172 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33367,1676494887582' in zk 2023-02-15 21:01:32,172 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,173 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,173 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 21:01:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:32,173 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,173 DEBUG [member: 'jenkins-hbase4.apache.org,43709,1676494887624' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 21:01:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:32,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:32,175 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,175 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 21:01:32,175 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:32,175 DEBUG [member: 'jenkins-hbase4.apache.org,33367,1676494887582' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 21:01:32,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43709,1676494887624': 2023-02-15 21:01:32,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43709,1676494887624' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-15 21:01:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33367,1676494887582': 2023-02-15 21:01:32,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33367,1676494887582' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 21:01:32,181 INFO [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 21:01:32,181 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:32,181 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:32,181 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 21:01:32,181 INFO [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:32,184 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:32,184 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:32,184 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:32,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:32,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:32,185 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,185 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:32,187 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:32,187 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,189 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,189 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:32,189 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:32,190 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:32,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:32,190 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:32,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:32,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:32,190 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:32,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:32,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:32,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:32,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:32,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:32,197 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,197 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:32,197 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,197 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,197 DEBUG [(jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:32,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 21:01:32,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:01:32,197 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,198 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:32,198 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:32,198 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:32,198 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:01:32,298 DEBUG [Listener at localhost/33425] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:01:32,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34955] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:01:32,300 INFO [Listener at localhost/33425] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:01:32,300 DEBUG [Listener at localhost/33425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x064951b6 to 127.0.0.1:55483 2023-02-15 21:01:32,300 DEBUG [Listener at localhost/33425] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,300 DEBUG [Listener at localhost/33425] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:01:32,301 DEBUG [Listener at localhost/33425] util.JVMClusterUtil(257): Found active master hash=975692900, stopped=false 2023-02-15 21:01:32,301 INFO [Listener at localhost/33425] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:32,302 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:32,302 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:32,302 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:32,302 INFO [Listener at localhost/33425] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:01:32,302 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:32,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:32,304 DEBUG [Listener at localhost/33425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c91b748 to 127.0.0.1:55483 2023-02-15 21:01:32,304 DEBUG [Listener at localhost/33425] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:32,304 INFO [Listener at localhost/33425] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33367,1676494887582' ***** 2023-02-15 21:01:32,304 INFO [Listener at localhost/33425] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:32,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:32,304 INFO [Listener at localhost/33425] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43709,1676494887624' ***** 2023-02-15 21:01:32,304 INFO [RS:0;jenkins-hbase4:33367] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:32,304 INFO [Listener at localhost/33425] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:32,305 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:32,305 INFO [RS:0;jenkins-hbase4:33367] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:32,305 INFO [RS:1;jenkins-hbase4:43709] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:32,306 INFO [RS:1;jenkins-hbase4:43709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:32,306 INFO [RS:1;jenkins-hbase4:43709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:32,306 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(3304): Received CLOSE for 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:32,306 INFO [RS:0;jenkins-hbase4:33367] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:32,306 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(3304): Received CLOSE for f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:32,306 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:32,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 618a9e646ce2cfbf1737008291010876, disabling compactions & flushes 2023-02-15 21:01:32,306 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:32,306 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:32,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:32,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b4a3bb5db3fb5bc1e1bdc8e6d23242ad, disabling compactions & flushes 2023-02-15 21:01:32,306 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(3304): Received CLOSE for 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:32,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:32,307 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(3304): Received CLOSE for 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:32,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:32,307 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:32,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. after waiting 0 ms 2023-02-15 21:01:32,307 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:32,307 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(3304): Received CLOSE for 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:32,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:32,307 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. after waiting 0 ms 2023-02-15 21:01:32,308 DEBUG [RS:1;jenkins-hbase4:43709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70ab45a5 to 127.0.0.1:55483 2023-02-15 21:01:32,307 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:32,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:32,308 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for 5fa18c137669e4b994f2f2fb63d85f7b 2023-02-15 21:01:32,308 DEBUG [RS:1;jenkins-hbase4:43709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,308 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,308 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-15 21:01:32,308 DEBUG [RS:0;jenkins-hbase4:33367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6356f1fe to 127.0.0.1:55483 2023-02-15 21:01:32,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:32,308 DEBUG [RS:0;jenkins-hbase4:33367] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,308 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1479): Online Regions={618a9e646ce2cfbf1737008291010876=testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876., f29c49048af3bcf5eaf4a08b9b2ac2da=testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da., 9b6caa699073c6abe425d26e7dc3518f=testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f., 47ac5746381319486a87bab039f7dc73=testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73., 622d88e18bc49271e0c86cfefb4fd090=testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.} 2023-02-15 21:01:32,308 INFO [RS:0;jenkins-hbase4:33367] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:32,308 DEBUG [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1505): Waiting on 47ac5746381319486a87bab039f7dc73, 618a9e646ce2cfbf1737008291010876, 622d88e18bc49271e0c86cfefb4fd090, 9b6caa699073c6abe425d26e7dc3518f, f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:32,308 INFO [RS:0;jenkins-hbase4:33367] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:32,308 INFO [RS:0;jenkins-hbase4:33367] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:32,308 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:01:32,311 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-15 21:01:32,312 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1479): Online Regions={b4a3bb5db3fb5bc1e1bdc8e6d23242ad=testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad., 29e99b3a6b63453a9e70481c093d51bf=testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf., 43fb4f5a4a4445bf6be71546c7897e99=testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99., dc976705211f99d13495c680e21a1f7b=testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b., 1588230740=hbase:meta,,1.1588230740, a92a92f4d2fefe2acd5c29ba52247063=testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063., 5fa18c137669e4b994f2f2fb63d85f7b=hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b.} 2023-02-15 21:01:32,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:32,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:32,312 DEBUG [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1505): Waiting on 1588230740, 29e99b3a6b63453a9e70481c093d51bf, 43fb4f5a4a4445bf6be71546c7897e99, 5fa18c137669e4b994f2f2fb63d85f7b, a92a92f4d2fefe2acd5c29ba52247063, b4a3bb5db3fb5bc1e1bdc8e6d23242ad, dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:32,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:32,314 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:32,314 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:32,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-15 21:01:32,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:32,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f29c49048af3bcf5eaf4a08b9b2ac2da, disabling compactions & flushes 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 29e99b3a6b63453a9e70481c093d51bf, disabling compactions & flushes 2023-02-15 21:01:32,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:32,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. after waiting 0 ms 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. after waiting 0 ms 2023-02-15 21:01:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:32,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 21:01:32,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:32,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:32,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:32,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9b6caa699073c6abe425d26e7dc3518f, disabling compactions & flushes 2023-02-15 21:01:32,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:32,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:32,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/.tmp/info/1f3b39a5b5c04921bae90d85b1b3dfbe 2023-02-15 21:01:32,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. after waiting 0 ms 2023-02-15 21:01:32,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:32,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:32,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:32,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:32,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 43fb4f5a4a4445bf6be71546c7897e99, disabling compactions & flushes 2023-02-15 21:01:32,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:32,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:32,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. after waiting 0 ms 2023-02-15 21:01:32,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:32,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 21:01:32,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:32,356 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:32,356 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:32,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 47ac5746381319486a87bab039f7dc73, disabling compactions & flushes 2023-02-15 21:01:32,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:32,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:32,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. after waiting 0 ms 2023-02-15 21:01:32,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:32,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dc976705211f99d13495c680e21a1f7b, disabling compactions & flushes 2023-02-15 21:01:32,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. after waiting 0 ms 2023-02-15 21:01:32,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:32,368 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/.tmp/table/c893df345d3c4cfca4201245e56d0c9d 2023-02-15 21:01:32,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 622d88e18bc49271e0c86cfefb4fd090, disabling compactions & flushes 2023-02-15 21:01:32,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. after waiting 0 ms 2023-02-15 21:01:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:32,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:32,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:32,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:32,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a92a92f4d2fefe2acd5c29ba52247063, disabling compactions & flushes 2023-02-15 21:01:32,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:32,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:32,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. after waiting 0 ms 2023-02-15 21:01:32,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:32,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/.tmp/info/1f3b39a5b5c04921bae90d85b1b3dfbe as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/info/1f3b39a5b5c04921bae90d85b1b3dfbe 2023-02-15 21:01:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:32,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:32,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:32,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5fa18c137669e4b994f2f2fb63d85f7b, disabling compactions & flushes 2023-02-15 21:01:32,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. after waiting 0 ms 2023-02-15 21:01:32,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:32,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5fa18c137669e4b994f2f2fb63d85f7b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:01:32,382 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/info/1f3b39a5b5c04921bae90d85b1b3dfbe, entries=110, sequenceid=32, filesize=18.7 K 2023-02-15 21:01:32,383 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/.tmp/table/c893df345d3c4cfca4201245e56d0c9d as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/table/c893df345d3c4cfca4201245e56d0c9d 2023-02-15 21:01:32,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/table/c893df345d3c4cfca4201245e56d0c9d, entries=4, sequenceid=32, filesize=4.8 K 2023-02-15 21:01:32,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=32, compaction requested=false 2023-02-15 21:01:32,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-15 21:01:32,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/.tmp/info/3538c361d00b4b08be38fc0e7d99fd52 2023-02-15 21:01:32,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-15 21:01:32,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:32,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:32,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:32,399 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:32,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/.tmp/info/3538c361d00b4b08be38fc0e7d99fd52 as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/info/3538c361d00b4b08be38fc0e7d99fd52 2023-02-15 21:01:32,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/info/3538c361d00b4b08be38fc0e7d99fd52, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:01:32,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5fa18c137669e4b994f2f2fb63d85f7b in 26ms, sequenceid=6, compaction requested=false 2023-02-15 21:01:32,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-15 21:01:32,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/data/hbase/namespace/5fa18c137669e4b994f2f2fb63d85f7b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:01:32,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:32,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5fa18c137669e4b994f2f2fb63d85f7b: 2023-02-15 21:01:32,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494888392.5fa18c137669e4b994f2f2fb63d85f7b. 2023-02-15 21:01:32,508 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43709,1676494887624; all regions closed. 2023-02-15 21:01:32,513 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33367,1676494887582; all regions closed. 2023-02-15 21:01:32,513 DEBUG [RS:1;jenkins-hbase4:43709] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/oldWALs 2023-02-15 21:01:32,514 INFO [RS:1;jenkins-hbase4:43709] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43709%2C1676494887624:(num 1676494888996) 2023-02-15 21:01:32,514 DEBUG [RS:1;jenkins-hbase4:43709] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,514 INFO [RS:1;jenkins-hbase4:43709] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:32,516 INFO [RS:1;jenkins-hbase4:43709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:32,516 INFO [RS:1;jenkins-hbase4:43709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:32,516 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:32,516 INFO [RS:1;jenkins-hbase4:43709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:32,516 INFO [RS:1;jenkins-hbase4:43709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:32,517 INFO [RS:1;jenkins-hbase4:43709] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43709 2023-02-15 21:01:32,520 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:32,520 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,520 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43709,1676494887624 2023-02-15 21:01:32,520 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:32,520 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:32,520 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c20c689 rejected from java.util.concurrent.ThreadPoolExecutor@281f47d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:32,521 DEBUG [RS:0;jenkins-hbase4:33367] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/oldWALs 2023-02-15 21:01:32,521 INFO [RS:0;jenkins-hbase4:33367] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33367%2C1676494887582.meta:.meta(num 1676494888320) 2023-02-15 21:01:32,521 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43709,1676494887624] 2023-02-15 21:01:32,521 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43709,1676494887624; numProcessing=1 2023-02-15 21:01:32,524 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43709,1676494887624 already deleted, retry=false 2023-02-15 21:01:32,524 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43709,1676494887624 expired; onlineServers=1 2023-02-15 21:01:32,526 DEBUG [RS:0;jenkins-hbase4:33367] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/oldWALs 2023-02-15 21:01:32,526 INFO [RS:0;jenkins-hbase4:33367] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33367%2C1676494887582:(num 1676494888752) 2023-02-15 21:01:32,527 DEBUG [RS:0;jenkins-hbase4:33367] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,527 INFO [RS:0;jenkins-hbase4:33367] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:32,527 INFO [RS:0;jenkins-hbase4:33367] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:32,527 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:32,528 INFO [RS:0;jenkins-hbase4:33367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33367 2023-02-15 21:01:32,530 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33367,1676494887582 2023-02-15 21:01:32,530 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:32,530 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b69542c rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:32,530 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33367,1676494887582] 2023-02-15 21:01:32,531 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33367,1676494887582; numProcessing=2 2023-02-15 21:01:32,538 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33367,1676494887582 already deleted, retry=false 2023-02-15 21:01:32,538 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33367,1676494887582 expired; onlineServers=0 2023-02-15 21:01:32,538 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34955,1676494887495' ***** 2023-02-15 21:01:32,538 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:01:32,539 DEBUG [M:0;jenkins-hbase4:34955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b1aee5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:32,539 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34955,1676494887495 2023-02-15 21:01:32,539 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34955,1676494887495; all regions closed. 2023-02-15 21:01:32,539 DEBUG [M:0;jenkins-hbase4:34955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:32,539 DEBUG [M:0;jenkins-hbase4:34955] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:01:32,539 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:01:32,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494887880] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494887880,5,FailOnTimeoutGroup] 2023-02-15 21:01:32,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494887880] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494887880,5,FailOnTimeoutGroup] 2023-02-15 21:01:32,539 DEBUG [M:0;jenkins-hbase4:34955] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:01:32,540 INFO [M:0;jenkins-hbase4:34955] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:01:32,541 INFO [M:0;jenkins-hbase4:34955] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:01:32,541 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:32,541 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:32,541 INFO [M:0;jenkins-hbase4:34955] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:01:32,541 DEBUG [M:0;jenkins-hbase4:34955] master.HMaster(1512): Stopping service threads 2023-02-15 21:01:32,541 INFO [M:0;jenkins-hbase4:34955] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:01:32,541 ERROR [M:0;jenkins-hbase4:34955] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 21:01:32,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:32,541 INFO [M:0;jenkins-hbase4:34955] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:01:32,542 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:01:32,542 DEBUG [M:0;jenkins-hbase4:34955] zookeeper.ZKUtil(398): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:01:32,542 WARN [M:0;jenkins-hbase4:34955] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:01:32,542 INFO [M:0;jenkins-hbase4:34955] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:01:32,542 INFO [M:0;jenkins-hbase4:34955] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:01:32,542 DEBUG [M:0;jenkins-hbase4:34955] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:32,542 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:32,542 DEBUG [M:0;jenkins-hbase4:34955] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:32,542 DEBUG [M:0;jenkins-hbase4:34955] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:32,542 DEBUG [M:0;jenkins-hbase4:34955] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:32,543 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-15 21:01:32,551 INFO [M:0;jenkins-hbase4:34955] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/108c085d4e1242f68c4dd6a595abf98c 2023-02-15 21:01:32,556 DEBUG [M:0;jenkins-hbase4:34955] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/108c085d4e1242f68c4dd6a595abf98c as hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/108c085d4e1242f68c4dd6a595abf98c 2023-02-15 21:01:32,561 INFO [M:0;jenkins-hbase4:34955] regionserver.HStore(1080): Added hdfs://localhost:35019/user/jenkins/test-data/ec206e49-056c-1c98-3471-c2fc67234bb2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/108c085d4e1242f68c4dd6a595abf98c, entries=31, sequenceid=218, filesize=9.0 K 2023-02-15 21:01:32,562 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-15 21:01:32,562 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:32,562 DEBUG [M:0;jenkins-hbase4:34955] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:32,567 INFO [M:0;jenkins-hbase4:34955] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:01:32,567 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:32,567 INFO [M:0;jenkins-hbase4:34955] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34955 2023-02-15 21:01:32,571 DEBUG [M:0;jenkins-hbase4:34955] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34955,1676494887495 already deleted, retry=false 2023-02-15 21:01:32,805 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:32,805 INFO [M:0;jenkins-hbase4:34955] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34955,1676494887495; zookeeper connection closed. 2023-02-15 21:01:32,805 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3701614b rejected from java.util.concurrent.ThreadPoolExecutor@333ee373[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:32,806 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34955-0x10059c9c3dd0000, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:32,806 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b377324 rejected from java.util.concurrent.ThreadPoolExecutor@333ee373[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:32,905 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:32,905 INFO [RS:0;jenkins-hbase4:33367] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33367,1676494887582; zookeeper connection closed. 2023-02-15 21:01:32,905 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3add9c4e rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:32,905 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:33367-0x10059c9c3dd0001, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:32,905 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f69a721] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f69a721 2023-02-15 21:01:32,905 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4277ebe7 rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:33,005 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:33,005 INFO [RS:1;jenkins-hbase4:43709] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43709,1676494887624; zookeeper connection closed. 2023-02-15 21:01:33,005 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@760447b0 rejected from java.util.concurrent.ThreadPoolExecutor@281f47d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:33,006 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:43709-0x10059c9c3dd0002, quorum=127.0.0.1:55483, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:33,006 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@300a81a5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@300a81a5 2023-02-15 21:01:33,006 ERROR [Listener at localhost/33425-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ec916ca rejected from java.util.concurrent.ThreadPoolExecutor@281f47d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:33,006 INFO [Listener at localhost/33425] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:01:33,092 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop-7222606159649417738.jar 2023-02-15 21:01:33,097 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676494890315 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:33,098 DEBUG [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce 2023-02-15 21:01:33,098 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:33,098 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(239): region to add: 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=618a9e646ce2cfbf1737008291010876 as 618a9e646ce2cfbf1737008291010876 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=b4a3bb5db3fb5bc1e1bdc8e6d23242ad as b4a3bb5db3fb5bc1e1bdc8e6d23242ad in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,099 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=f29c49048af3bcf5eaf4a08b9b2ac2da as f29c49048af3bcf5eaf4a08b9b2ac2da in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=9b6caa699073c6abe425d26e7dc3518f as 9b6caa699073c6abe425d26e7dc3518f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=29e99b3a6b63453a9e70481c093d51bf as 29e99b3a6b63453a9e70481c093d51bf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=43fb4f5a4a4445bf6be71546c7897e99 as 43fb4f5a4a4445bf6be71546c7897e99 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=dc976705211f99d13495c680e21a1f7b as dc976705211f99d13495c680e21a1f7b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=a92a92f4d2fefe2acd5c29ba52247063 as a92a92f4d2fefe2acd5c29ba52247063 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=47ac5746381319486a87bab039f7dc73 as 47ac5746381319486a87bab039f7dc73 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,100 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(585): clone region=622d88e18bc49271e0c86cfefb4fd090 as 622d88e18bc49271e0c86cfefb4fd090 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-15 21:01:33,101 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => f29c49048af3bcf5eaf4a08b9b2ac2da, NAME => 'testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,101 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => b4a3bb5db3fb5bc1e1bdc8e6d23242ad, NAME => 'testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,101 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 618a9e646ce2cfbf1737008291010876, NAME => 'testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,104 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9b6caa699073c6abe425d26e7dc3518f, NAME => 'testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,105 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 29e99b3a6b63453a9e70481c093d51bf, NAME => 'testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,105 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a92a92f4d2fefe2acd5c29ba52247063, NAME => 'testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,106 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => dc976705211f99d13495c680e21a1f7b, NAME => 'testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,106 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 43fb4f5a4a4445bf6be71546c7897e99, NAME => 'testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,140 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,140 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2326489b7646410faa7768983274ef0f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,141 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,142 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1ed1ea379e6c4985903972f2d5eb9847 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9b6caa699073c6abe425d26e7dc3518f, disabling compactions & flushes 2023-02-15 21:01:33,147 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:33,147 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 11b0e2b205634220bd8fb4b6a668ab7d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. after waiting 0 ms 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:33,147 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:33,147 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7da26467cac44c47992c6b3857226daf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:33,147 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,148 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 872b3c6091aa4f2d9acb7bd57a6a4068 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,148 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 47ac5746381319486a87bab039f7dc73, NAME => 'testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,152 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,152 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ba06ab7af184b96a56b1bf926585f87 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing b4a3bb5db3fb5bc1e1bdc8e6d23242ad, disabling compactions & flushes 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 618a9e646ce2cfbf1737008291010876, disabling compactions & flushes 2023-02-15 21:01:33,161 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:33,161 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. after waiting 0 ms 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. after waiting 0 ms 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:33,161 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,161 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b18979b92cbc49ee971bf819ffd22cfa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:33,162 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:33,161 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:33,162 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 622d88e18bc49271e0c86cfefb4fd090, NAME => 'testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,161 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7aa186984d084ce4be313ea6404574ae from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,162 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:33,164 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,164 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink afb9dd554da747ad81dc86990dfe7425 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,165 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d771ad24726d4832b5eac2e72e9bb62a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,167 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 29e99b3a6b63453a9e70481c093d51bf, disabling compactions & flushes 2023-02-15 21:01:33,167 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,167 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,167 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. after waiting 0 ms 2023-02-15 21:01:33,167 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,167 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,167 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:33,167 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bd0d67976f6f4b39b1c431f922d3b422 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,167 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac31086dc6e64462bc5de8a168143665 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,179 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing dc976705211f99d13495c680e21a1f7b, disabling compactions & flushes 2023-02-15 21:01:33,179 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:33,179 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a92a92f4d2fefe2acd5c29ba52247063, disabling compactions & flushes 2023-02-15 21:01:33,179 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:33,179 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:33,179 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. after waiting 0 ms 2023-02-15 21:01:33,179 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:33,179 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. after waiting 0 ms 2023-02-15 21:01:33,180 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:33,180 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 43fb4f5a4a4445bf6be71546c7897e99, disabling compactions & flushes 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,180 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:33,180 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a8ce56f6f726475796c97c808bef86c4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:33,180 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. after waiting 0 ms 2023-02-15 21:01:33,181 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:33,181 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:33,181 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:33,182 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d5aac87bf7684813a48f6adcdd3cba6c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,184 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 622d88e18bc49271e0c86cfefb4fd090, disabling compactions & flushes 2023-02-15 21:01:33,184 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:33,184 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:33,184 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. after waiting 0 ms 2023-02-15 21:01:33,184 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:33,184 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:33,184 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:33,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,546 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing f29c49048af3bcf5eaf4a08b9b2ac2da, disabling compactions & flushes 2023-02-15 21:01:33,547 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:33,547 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:33,547 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. after waiting 0 ms 2023-02-15 21:01:33,547 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:33,547 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:33,547 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:33,575 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,575 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 613c373cfc0c434abd9443ca48d66753 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,578 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ed3979b38f7d4776b7e0075d1fbc85a0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-15 21:01:33,580 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 47ac5746381319486a87bab039f7dc73, disabling compactions & flushes 2023-02-15 21:01:33,580 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:33,580 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:33,580 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. after waiting 0 ms 2023-02-15 21:01:33,580 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:33,580 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:33,580 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:33,580 INFO [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676494890315 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:33,581 DEBUG [Listener at localhost/33425] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,581 DEBUG [Listener at localhost/33425] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45 2023-02-15 21:01:33,581 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-data/ 2023-02-15 21:01:33,582 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----default/ 2023-02-15 21:01:33,582 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 21:01:33,583 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------29e99b3a6b63453a9e70481c093d51bf/ 2023-02-15 21:01:33,583 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,583 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,584 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=29e99b3a6b63453a9e70481c093d51bf-872b3c6091aa4f2d9acb7bd57a6a4068 2023-02-15 21:01:33,584 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,584 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=29e99b3a6b63453a9e70481c093d51bf-7aa186984d084ce4be313ea6404574ae 2023-02-15 21:01:33,585 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------43fb4f5a4a4445bf6be71546c7897e99/ 2023-02-15 21:01:33,585 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,585 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,586 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=43fb4f5a4a4445bf6be71546c7897e99-afb9dd554da747ad81dc86990dfe7425 2023-02-15 21:01:33,586 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,586 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=43fb4f5a4a4445bf6be71546c7897e99-ac31086dc6e64462bc5de8a168143665 2023-02-15 21:01:33,586 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------47ac5746381319486a87bab039f7dc73/ 2023-02-15 21:01:33,587 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,587 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,588 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=47ac5746381319486a87bab039f7dc73-613c373cfc0c434abd9443ca48d66753 2023-02-15 21:01:33,588 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,588 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=47ac5746381319486a87bab039f7dc73-ed3979b38f7d4776b7e0075d1fbc85a0 2023-02-15 21:01:33,588 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------618a9e646ce2cfbf1737008291010876/ 2023-02-15 21:01:33,589 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,589 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,589 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=618a9e646ce2cfbf1737008291010876-1ed1ea379e6c4985903972f2d5eb9847 2023-02-15 21:01:33,590 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,590 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=618a9e646ce2cfbf1737008291010876-7da26467cac44c47992c6b3857226daf 2023-02-15 21:01:33,590 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------622d88e18bc49271e0c86cfefb4fd090/ 2023-02-15 21:01:33,591 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,591 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,591 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=622d88e18bc49271e0c86cfefb4fd090-a8ce56f6f726475796c97c808bef86c4 2023-02-15 21:01:33,591 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,592 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=622d88e18bc49271e0c86cfefb4fd090-d5aac87bf7684813a48f6adcdd3cba6c 2023-02-15 21:01:33,592 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------9b6caa699073c6abe425d26e7dc3518f/ 2023-02-15 21:01:33,592 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,593 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------a92a92f4d2fefe2acd5c29ba52247063/ 2023-02-15 21:01:33,593 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,593 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,594 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=a92a92f4d2fefe2acd5c29ba52247063-b18979b92cbc49ee971bf819ffd22cfa 2023-02-15 21:01:33,594 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,594 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=a92a92f4d2fefe2acd5c29ba52247063-bd0d67976f6f4b39b1c431f922d3b422 2023-02-15 21:01:33,594 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------b4a3bb5db3fb5bc1e1bdc8e6d23242ad/ 2023-02-15 21:01:33,595 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,595 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,595 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=b4a3bb5db3fb5bc1e1bdc8e6d23242ad-2326489b7646410faa7768983274ef0f 2023-02-15 21:01:33,595 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,596 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=b4a3bb5db3fb5bc1e1bdc8e6d23242ad-11b0e2b205634220bd8fb4b6a668ab7d 2023-02-15 21:01:33,596 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------dc976705211f99d13495c680e21a1f7b/ 2023-02-15 21:01:33,596 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,596 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:33,597 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=dc976705211f99d13495c680e21a1f7b-0ba06ab7af184b96a56b1bf926585f87 2023-02-15 21:01:33,597 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:33,597 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |----------------testWithMapReduce=dc976705211f99d13495c680e21a1f7b-d771ad24726d4832b5eac2e72e9bb62a 2023-02-15 21:01:33,597 DEBUG [Listener at localhost/33425] util.CommonFSUtils(699): |----------f29c49048af3bcf5eaf4a08b9b2ac2da/ 2023-02-15 21:01:33,597 DEBUG [Listener at localhost/33425] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:33,598 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,598 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,598 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,599 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,599 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,599 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,600 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,665 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop-349826006476153483.jar 2023-02-15 21:01:33,666 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,666 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,667 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,667 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,667 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,667 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,668 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 21:01:33,668 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 21:01:33,669 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 21:01:33,669 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 21:01:33,669 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 21:01:33,670 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 21:01:33,670 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 21:01:33,670 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 21:01:33,671 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 21:01:33,671 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 21:01:33,672 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 21:01:33,672 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:01:33,672 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:01:33,673 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:01:33,673 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 21:01:33,738 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop-7105419877384865871.jar 2023-02-15 21:01:33,738 DEBUG [Listener at localhost/33425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 21:01:33,744 WARN [Listener at localhost/33425] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 21:01:33,774 INFO [Listener at localhost/33425] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 21:01:33,869 WARN [Listener at localhost/33425] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/mapreduce.cluster.local.dir/1676494893839/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 21:01:33,870 WARN [Listener at localhost/33425] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/mapreduce.cluster.local.dir/1676494893839/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 21:01:33,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,914 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:33,915 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:33,916 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:33,917 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1 2023-02-15 21:01:33,918 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29e99b3a6b63453a9e70481c093d51bf columnFamilyName f1 2023-02-15 21:01:33,923 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f1/testWithMapReduce=29e99b3a6b63453a9e70481c093d51bf-872b3c6091aa4f2d9acb7bd57a6a4068 2023-02-15 21:01:33,923 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(310): Store=29e99b3a6b63453a9e70481c093d51bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:33,924 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 29e99b3a6b63453a9e70481c093d51bf 2023-02-15 21:01:33,925 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2 2023-02-15 21:01:33,925 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29e99b3a6b63453a9e70481c093d51bf columnFamilyName f2 2023-02-15 21:01:33,929 DEBUG [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/29e99b3a6b63453a9e70481c093d51bf/f2/testWithMapReduce=29e99b3a6b63453a9e70481c093d51bf-7aa186984d084ce4be313ea6404574ae 2023-02-15 21:01:33,929 INFO [StoreOpener-29e99b3a6b63453a9e70481c093d51bf-1] regionserver.HStore(310): Store=29e99b3a6b63453a9e70481c093d51bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:33,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:33,930 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 29e99b3a6b63453a9e70481c093d51bf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61289382, jitterRate=-0.08671703934669495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:33,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:33,973 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 29e99b3a6b63453a9e70481c093d51bf, disabling compactions & flushes 2023-02-15 21:01:33,973 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,973 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,974 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. after waiting 0 ms 2023-02-15 21:01:33,974 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,974 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676494888989.29e99b3a6b63453a9e70481c093d51bf. 2023-02-15 21:01:33,975 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 29e99b3a6b63453a9e70481c093d51bf: 2023-02-15 21:01:33,978 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:33,978 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:33,982 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:33,985 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:33,986 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1 2023-02-15 21:01:33,986 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43fb4f5a4a4445bf6be71546c7897e99 columnFamilyName f1 2023-02-15 21:01:33,992 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f1/testWithMapReduce=43fb4f5a4a4445bf6be71546c7897e99-afb9dd554da747ad81dc86990dfe7425 2023-02-15 21:01:33,992 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(310): Store=43fb4f5a4a4445bf6be71546c7897e99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:33,993 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 43fb4f5a4a4445bf6be71546c7897e99 2023-02-15 21:01:33,994 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2 2023-02-15 21:01:33,994 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43fb4f5a4a4445bf6be71546c7897e99 columnFamilyName f2 2023-02-15 21:01:34,000 DEBUG [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/43fb4f5a4a4445bf6be71546c7897e99/f2/testWithMapReduce=43fb4f5a4a4445bf6be71546c7897e99-ac31086dc6e64462bc5de8a168143665 2023-02-15 21:01:34,000 INFO [StoreOpener-43fb4f5a4a4445bf6be71546c7897e99-1] regionserver.HStore(310): Store=43fb4f5a4a4445bf6be71546c7897e99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,000 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,000 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 43fb4f5a4a4445bf6be71546c7897e99; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61435175, jitterRate=-0.08454455435276031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,000 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:34,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 43fb4f5a4a4445bf6be71546c7897e99, disabling compactions & flushes 2023-02-15 21:01:34,029 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:34,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:34,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. after waiting 0 ms 2023-02-15 21:01:34,029 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:34,030 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676494888989.43fb4f5a4a4445bf6be71546c7897e99. 2023-02-15 21:01:34,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 43fb4f5a4a4445bf6be71546c7897e99: 2023-02-15 21:01:34,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,034 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,037 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,039 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:34,040 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1 2023-02-15 21:01:34,040 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47ac5746381319486a87bab039f7dc73 columnFamilyName f1 2023-02-15 21:01:34,047 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f1/testWithMapReduce=47ac5746381319486a87bab039f7dc73-613c373cfc0c434abd9443ca48d66753 2023-02-15 21:01:34,048 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(310): Store=47ac5746381319486a87bab039f7dc73/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,048 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 47ac5746381319486a87bab039f7dc73 2023-02-15 21:01:34,048 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2 2023-02-15 21:01:34,049 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47ac5746381319486a87bab039f7dc73 columnFamilyName f2 2023-02-15 21:01:34,053 DEBUG [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/47ac5746381319486a87bab039f7dc73/f2/testWithMapReduce=47ac5746381319486a87bab039f7dc73-ed3979b38f7d4776b7e0075d1fbc85a0 2023-02-15 21:01:34,054 INFO [StoreOpener-47ac5746381319486a87bab039f7dc73-1] regionserver.HStore(310): Store=47ac5746381319486a87bab039f7dc73/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 47ac5746381319486a87bab039f7dc73; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59185967, jitterRate=-0.11806036531925201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:34,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 47ac5746381319486a87bab039f7dc73, disabling compactions & flushes 2023-02-15 21:01:34,089 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:34,089 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:34,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. after waiting 0 ms 2023-02-15 21:01:34,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:34,092 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676494888989.47ac5746381319486a87bab039f7dc73. 2023-02-15 21:01:34,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 47ac5746381319486a87bab039f7dc73: 2023-02-15 21:01:34,096 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,096 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,097 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,099 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:34,100 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1 2023-02-15 21:01:34,101 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618a9e646ce2cfbf1737008291010876 columnFamilyName f1 2023-02-15 21:01:34,111 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f1/testWithMapReduce=618a9e646ce2cfbf1737008291010876-1ed1ea379e6c4985903972f2d5eb9847 2023-02-15 21:01:34,111 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(310): Store=618a9e646ce2cfbf1737008291010876/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,112 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 618a9e646ce2cfbf1737008291010876 2023-02-15 21:01:34,112 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2 2023-02-15 21:01:34,113 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 618a9e646ce2cfbf1737008291010876 columnFamilyName f2 2023-02-15 21:01:34,117 DEBUG [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/618a9e646ce2cfbf1737008291010876/f2/testWithMapReduce=618a9e646ce2cfbf1737008291010876-7da26467cac44c47992c6b3857226daf 2023-02-15 21:01:34,117 INFO [StoreOpener-618a9e646ce2cfbf1737008291010876-1] regionserver.HStore(310): Store=618a9e646ce2cfbf1737008291010876/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,117 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,118 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 618a9e646ce2cfbf1737008291010876; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72082645, jitterRate=0.07411511242389679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:34,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 618a9e646ce2cfbf1737008291010876, disabling compactions & flushes 2023-02-15 21:01:34,154 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:34,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:34,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. after waiting 0 ms 2023-02-15 21:01:34,154 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:34,155 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676494888989.618a9e646ce2cfbf1737008291010876. 2023-02-15 21:01:34,155 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 618a9e646ce2cfbf1737008291010876: 2023-02-15 21:01:34,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,158 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,159 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,161 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:34,162 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1 2023-02-15 21:01:34,162 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d88e18bc49271e0c86cfefb4fd090 columnFamilyName f1 2023-02-15 21:01:34,167 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f1/testWithMapReduce=622d88e18bc49271e0c86cfefb4fd090-a8ce56f6f726475796c97c808bef86c4 2023-02-15 21:01:34,167 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(310): Store=622d88e18bc49271e0c86cfefb4fd090/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,167 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 622d88e18bc49271e0c86cfefb4fd090 2023-02-15 21:01:34,168 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2 2023-02-15 21:01:34,168 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 622d88e18bc49271e0c86cfefb4fd090 columnFamilyName f2 2023-02-15 21:01:34,173 DEBUG [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/622d88e18bc49271e0c86cfefb4fd090/f2/testWithMapReduce=622d88e18bc49271e0c86cfefb4fd090-d5aac87bf7684813a48f6adcdd3cba6c 2023-02-15 21:01:34,173 INFO [StoreOpener-622d88e18bc49271e0c86cfefb4fd090-1] regionserver.HStore(310): Store=622d88e18bc49271e0c86cfefb4fd090/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,173 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,173 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 622d88e18bc49271e0c86cfefb4fd090; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75292310, jitterRate=0.12194284796714783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,173 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:34,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 622d88e18bc49271e0c86cfefb4fd090, disabling compactions & flushes 2023-02-15 21:01:34,200 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:34,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:34,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. after waiting 0 ms 2023-02-15 21:01:34,200 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:34,201 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676494888989.622d88e18bc49271e0c86cfefb4fd090. 2023-02-15 21:01:34,201 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 622d88e18bc49271e0c86cfefb4fd090: 2023-02-15 21:01:34,205 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,205 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,207 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,208 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:34,209 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1 2023-02-15 21:01:34,209 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4a3bb5db3fb5bc1e1bdc8e6d23242ad columnFamilyName f1 2023-02-15 21:01:34,214 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1/testWithMapReduce=b4a3bb5db3fb5bc1e1bdc8e6d23242ad-2326489b7646410faa7768983274ef0f 2023-02-15 21:01:34,214 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(310): Store=b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,214 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4a3bb5db3fb5bc1e1bdc8e6d23242ad 2023-02-15 21:01:34,215 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2 2023-02-15 21:01:34,215 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4a3bb5db3fb5bc1e1bdc8e6d23242ad columnFamilyName f2 2023-02-15 21:01:34,219 DEBUG [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2/testWithMapReduce=b4a3bb5db3fb5bc1e1bdc8e6d23242ad-11b0e2b205634220bd8fb4b6a668ab7d 2023-02-15 21:01:34,219 INFO [StoreOpener-b4a3bb5db3fb5bc1e1bdc8e6d23242ad-1] regionserver.HStore(310): Store=b4a3bb5db3fb5bc1e1bdc8e6d23242ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,219 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b4a3bb5db3fb5bc1e1bdc8e6d23242ad; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71950605, jitterRate=0.07214756309986115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:34,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b4a3bb5db3fb5bc1e1bdc8e6d23242ad, disabling compactions & flushes 2023-02-15 21:01:34,247 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:34,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:34,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. after waiting 0 ms 2023-02-15 21:01:34,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:34,248 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676494888989.b4a3bb5db3fb5bc1e1bdc8e6d23242ad. 2023-02-15 21:01:34,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b4a3bb5db3fb5bc1e1bdc8e6d23242ad: 2023-02-15 21:01:34,251 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,251 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,252 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,254 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:34,255 DEBUG [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/f1 2023-02-15 21:01:34,255 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6caa699073c6abe425d26e7dc3518f columnFamilyName f1 2023-02-15 21:01:34,256 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(310): Store=9b6caa699073c6abe425d26e7dc3518f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,256 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9b6caa699073c6abe425d26e7dc3518f 2023-02-15 21:01:34,257 DEBUG [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/9b6caa699073c6abe425d26e7dc3518f/f2 2023-02-15 21:01:34,257 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6caa699073c6abe425d26e7dc3518f columnFamilyName f2 2023-02-15 21:01:34,258 INFO [StoreOpener-9b6caa699073c6abe425d26e7dc3518f-1] regionserver.HStore(310): Store=9b6caa699073c6abe425d26e7dc3518f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,258 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,258 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9b6caa699073c6abe425d26e7dc3518f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73607186, jitterRate=0.09683254361152649}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,258 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:34,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9b6caa699073c6abe425d26e7dc3518f, disabling compactions & flushes 2023-02-15 21:01:34,275 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:34,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:34,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. after waiting 0 ms 2023-02-15 21:01:34,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:34,275 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494888989.9b6caa699073c6abe425d26e7dc3518f. 2023-02-15 21:01:34,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9b6caa699073c6abe425d26e7dc3518f: 2023-02-15 21:01:34,278 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,278 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,279 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,281 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:34,282 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1 2023-02-15 21:01:34,282 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc976705211f99d13495c680e21a1f7b columnFamilyName f1 2023-02-15 21:01:34,282 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 21:01:34,286 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f1/testWithMapReduce=dc976705211f99d13495c680e21a1f7b-0ba06ab7af184b96a56b1bf926585f87 2023-02-15 21:01:34,287 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(310): Store=dc976705211f99d13495c680e21a1f7b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,287 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc976705211f99d13495c680e21a1f7b 2023-02-15 21:01:34,288 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2 2023-02-15 21:01:34,288 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc976705211f99d13495c680e21a1f7b columnFamilyName f2 2023-02-15 21:01:34,292 DEBUG [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/dc976705211f99d13495c680e21a1f7b/f2/testWithMapReduce=dc976705211f99d13495c680e21a1f7b-d771ad24726d4832b5eac2e72e9bb62a 2023-02-15 21:01:34,293 INFO [StoreOpener-dc976705211f99d13495c680e21a1f7b-1] regionserver.HStore(310): Store=dc976705211f99d13495c680e21a1f7b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,293 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dc976705211f99d13495c680e21a1f7b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60437160, jitterRate=-0.09941613674163818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,293 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:34,334 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dc976705211f99d13495c680e21a1f7b, disabling compactions & flushes 2023-02-15 21:01:34,335 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:34,335 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:34,335 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. after waiting 0 ms 2023-02-15 21:01:34,335 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:34,336 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676494888989.dc976705211f99d13495c680e21a1f7b. 2023-02-15 21:01:34,337 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dc976705211f99d13495c680e21a1f7b: 2023-02-15 21:01:34,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,342 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,345 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,347 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:34,348 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1 2023-02-15 21:01:34,348 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a92a92f4d2fefe2acd5c29ba52247063 columnFamilyName f1 2023-02-15 21:01:34,353 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f1/testWithMapReduce=a92a92f4d2fefe2acd5c29ba52247063-b18979b92cbc49ee971bf819ffd22cfa 2023-02-15 21:01:34,353 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(310): Store=a92a92f4d2fefe2acd5c29ba52247063/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,353 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a92a92f4d2fefe2acd5c29ba52247063 2023-02-15 21:01:34,354 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2 2023-02-15 21:01:34,355 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a92a92f4d2fefe2acd5c29ba52247063 columnFamilyName f2 2023-02-15 21:01:34,359 DEBUG [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(539): loaded hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/a92a92f4d2fefe2acd5c29ba52247063/f2/testWithMapReduce=a92a92f4d2fefe2acd5c29ba52247063-bd0d67976f6f4b39b1c431f922d3b422 2023-02-15 21:01:34,360 INFO [StoreOpener-a92a92f4d2fefe2acd5c29ba52247063-1] regionserver.HStore(310): Store=a92a92f4d2fefe2acd5c29ba52247063/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,360 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a92a92f4d2fefe2acd5c29ba52247063; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64500594, jitterRate=-0.038866251707077026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,360 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:34,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a92a92f4d2fefe2acd5c29ba52247063, disabling compactions & flushes 2023-02-15 21:01:34,398 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:34,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:34,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. after waiting 0 ms 2023-02-15 21:01:34,398 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:34,399 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676494888989.a92a92f4d2fefe2acd5c29ba52247063. 2023-02-15 21:01:34,399 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a92a92f4d2fefe2acd5c29ba52247063: 2023-02-15 21:01:34,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:34,402 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:34,403 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:34,406 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:34,407 DEBUG [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/f1 2023-02-15 21:01:34,407 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f29c49048af3bcf5eaf4a08b9b2ac2da columnFamilyName f1 2023-02-15 21:01:34,408 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(310): Store=f29c49048af3bcf5eaf4a08b9b2ac2da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,408 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f29c49048af3bcf5eaf4a08b9b2ac2da 2023-02-15 21:01:34,409 DEBUG [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35019/user/jenkins/test-data/4918e2ae-793a-4850-e79a-10bb03394145/testWithMapReduceAndOfflineHBaseMultiRegion/9c11796b-fe72-40d4-9589-40d0493fae45/data/default/testWithMapReduce/f29c49048af3bcf5eaf4a08b9b2ac2da/f2 2023-02-15 21:01:34,409 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f29c49048af3bcf5eaf4a08b9b2ac2da columnFamilyName f2 2023-02-15 21:01:34,410 INFO [StoreOpener-f29c49048af3bcf5eaf4a08b9b2ac2da-1] regionserver.HStore(310): Store=f29c49048af3bcf5eaf4a08b9b2ac2da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:34,410 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:34,411 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f29c49048af3bcf5eaf4a08b9b2ac2da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71868799, jitterRate=0.07092855870723724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:34,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:34,428 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f29c49048af3bcf5eaf4a08b9b2ac2da, disabling compactions & flushes 2023-02-15 21:01:34,428 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:34,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:34,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. after waiting 0 ms 2023-02-15 21:01:34,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:34,429 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676494888989.f29c49048af3bcf5eaf4a08b9b2ac2da. 2023-02-15 21:01:34,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f29c49048af3bcf5eaf4a08b9b2ac2da: 2023-02-15 21:01:34,915 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:01:34,915 WARN [Listener at localhost/33425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:34,921 INFO [Listener at localhost/33425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:35,026 WARN [BP-1031949836-172.31.14.131-1676494885996 heartbeating to localhost/127.0.0.1:35019] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:35,026 WARN [BP-1031949836-172.31.14.131-1676494885996 heartbeating to localhost/127.0.0.1:35019] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1031949836-172.31.14.131-1676494885996 (Datanode Uuid 7cf6d44f-fc88-4e6d-8f13-34145080968a) service to localhost/127.0.0.1:35019 2023-02-15 21:01:35,027 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/dfs/data/data3/current/BP-1031949836-172.31.14.131-1676494885996] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:35,027 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/dfs/data/data4/current/BP-1031949836-172.31.14.131-1676494885996] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:35,029 WARN [Listener at localhost/33425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:35,039 INFO [Listener at localhost/33425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:35,143 WARN [BP-1031949836-172.31.14.131-1676494885996 heartbeating to localhost/127.0.0.1:35019] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:35,144 WARN [BP-1031949836-172.31.14.131-1676494885996 heartbeating to localhost/127.0.0.1:35019] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1031949836-172.31.14.131-1676494885996 (Datanode Uuid e67f3bd7-4c03-48b3-b883-59fd036f3df3) service to localhost/127.0.0.1:35019 2023-02-15 21:01:35,144 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/dfs/data/data1/current/BP-1031949836-172.31.14.131-1676494885996] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:35,144 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/cluster_2cc5ee1f-5812-f783-d64f-fef01ac525c0/dfs/data/data2/current/BP-1031949836-172.31.14.131-1676494885996] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:35,155 INFO [Listener at localhost/33425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:35,283 INFO [Listener at localhost/33425] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:01:35,326 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:01:35,338 INFO [Listener at localhost/33425] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 104) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:35019 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:35019 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:35019 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,34955,1676494887495)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33425 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35019 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:35019 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:35019 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:35019 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=535 (was 529) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 241) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=2814 (was 3024) 2023-02-15 21:01:35,348 INFO [Listener at localhost/33425] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=166, AvailableMemoryMB=2814 2023-02-15 21:01:35,358 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop.log.dir so I do NOT create it in target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9 2023-02-15 21:01:35,358 WARN [Listener at localhost/33425] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 21:01:35,358 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop.tmp.dir so I do NOT create it in target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9 2023-02-15 21:01:35,358 WARN [Listener at localhost/33425] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00990b08-0f0e-8e44-ea3e-8cfd3ad1686f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 21:01:35,358 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9 2023-02-15 21:01:35,358 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e, deleteOnExit=true 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/test.cache.data in system properties and HBase conf 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:35,359 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:35,359 DEBUG [Listener at localhost/33425] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:35,360 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:35,361 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:35,361 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:35,361 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:35,365 WARN [Listener at localhost/33425] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:35,365 WARN [Listener at localhost/33425] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:35,403 WARN [Listener at localhost/33425] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:35,405 INFO [Listener at localhost/33425] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:35,410 INFO [Listener at localhost/33425] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/java.io.tmpdir/Jetty_localhost_46283_hdfs____ob9385/webapp 2023-02-15 21:01:35,502 INFO [Listener at localhost/33425] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46283 2023-02-15 21:01:35,506 WARN [Listener at localhost/33425] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:35,506 WARN [Listener at localhost/33425] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:35,545 WARN [Listener at localhost/37671] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:35,561 WARN [Listener at localhost/37671] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:35,563 WARN [Listener at localhost/37671] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:35,564 INFO [Listener at localhost/37671] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:35,570 INFO [Listener at localhost/37671] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/java.io.tmpdir/Jetty_localhost_34881_datanode____do5l3r/webapp 2023-02-15 21:01:35,660 INFO [Listener at localhost/37671] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34881 2023-02-15 21:01:35,668 WARN [Listener at localhost/43737] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:35,689 WARN [Listener at localhost/43737] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:35,691 WARN [Listener at localhost/43737] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:35,692 INFO [Listener at localhost/43737] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:35,696 INFO [Listener at localhost/43737] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/java.io.tmpdir/Jetty_localhost_45569_datanode____1qvmym/webapp 2023-02-15 21:01:35,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4ceb8735dc60a365: Processing first storage report for DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b from datanode c4347a25-6b91-47ef-81c5-bf3e1e47794d 2023-02-15 21:01:35,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4ceb8735dc60a365: from storage DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b node DatanodeRegistration(127.0.0.1:33091, datanodeUuid=c4347a25-6b91-47ef-81c5-bf3e1e47794d, infoPort=39433, infoSecurePort=0, ipcPort=43737, storageInfo=lv=-57;cid=testClusterID;nsid=1903305455;c=1676494895367), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:35,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4ceb8735dc60a365: Processing first storage report for DS-5bd2812a-884e-4917-8ae8-64ca0679f994 from datanode c4347a25-6b91-47ef-81c5-bf3e1e47794d 2023-02-15 21:01:35,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4ceb8735dc60a365: from storage DS-5bd2812a-884e-4917-8ae8-64ca0679f994 node DatanodeRegistration(127.0.0.1:33091, datanodeUuid=c4347a25-6b91-47ef-81c5-bf3e1e47794d, infoPort=39433, infoSecurePort=0, ipcPort=43737, storageInfo=lv=-57;cid=testClusterID;nsid=1903305455;c=1676494895367), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:35,798 INFO [Listener at localhost/43737] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45569 2023-02-15 21:01:35,807 WARN [Listener at localhost/34059] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:35,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf79d6ee5c27f128d: Processing first storage report for DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd from datanode 2adb20df-a9af-470d-9b86-a993d9d2b63d 2023-02-15 21:01:35,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf79d6ee5c27f128d: from storage DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd node DatanodeRegistration(127.0.0.1:35613, datanodeUuid=2adb20df-a9af-470d-9b86-a993d9d2b63d, infoPort=44445, infoSecurePort=0, ipcPort=34059, storageInfo=lv=-57;cid=testClusterID;nsid=1903305455;c=1676494895367), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:35,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf79d6ee5c27f128d: Processing first storage report for DS-fc0c22d1-6a6c-4a93-8642-f6432957489f from datanode 2adb20df-a9af-470d-9b86-a993d9d2b63d 2023-02-15 21:01:35,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf79d6ee5c27f128d: from storage DS-fc0c22d1-6a6c-4a93-8642-f6432957489f node DatanodeRegistration(127.0.0.1:35613, datanodeUuid=2adb20df-a9af-470d-9b86-a993d9d2b63d, infoPort=44445, infoSecurePort=0, ipcPort=34059, storageInfo=lv=-57;cid=testClusterID;nsid=1903305455;c=1676494895367), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:35,913 DEBUG [Listener at localhost/34059] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9 2023-02-15 21:01:35,915 INFO [Listener at localhost/34059] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/zookeeper_0, clientPort=54640, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:35,916 INFO [Listener at localhost/34059] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54640 2023-02-15 21:01:35,916 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,917 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,930 INFO [Listener at localhost/34059] util.FSUtils(479): Created version file at hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0 with version=8 2023-02-15 21:01:35,930 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,931 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,932 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37671/user/jenkins/test-data/2e63d023-14c6-f24c-80b9-b2f71cd278dd/hbase-staging 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:35,934 INFO [Listener at localhost/34059] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:35,936 INFO [Listener at localhost/34059] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45209 2023-02-15 21:01:35,936 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,937 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,937 INFO [Listener at localhost/34059] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45209 connecting to ZooKeeper ensemble=127.0.0.1:54640 2023-02-15 21:01:35,945 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:452090x0, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:35,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45209-0x10059c9e4ef0000 connected 2023-02-15 21:01:35,966 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:35,966 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:35,967 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:35,970 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45209 2023-02-15 21:01:35,970 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45209 2023-02-15 21:01:35,971 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45209 2023-02-15 21:01:35,972 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45209 2023-02-15 21:01:35,976 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45209 2023-02-15 21:01:35,976 INFO [Listener at localhost/34059] master.HMaster(444): hbase.rootdir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0, hbase.cluster.distributed=false 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:35,988 INFO [Listener at localhost/34059] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:35,990 INFO [Listener at localhost/34059] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36317 2023-02-15 21:01:35,990 INFO [Listener at localhost/34059] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:35,991 DEBUG [Listener at localhost/34059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:35,992 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,993 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:35,993 INFO [Listener at localhost/34059] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36317 connecting to ZooKeeper ensemble=127.0.0.1:54640 2023-02-15 21:01:35,996 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:363170x0, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:35,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36317-0x10059c9e4ef0001 connected 2023-02-15 21:01:35,998 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:35,998 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:35,999 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:36,002 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36317 2023-02-15 21:01:36,002 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36317 2023-02-15 21:01:36,004 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36317 2023-02-15 21:01:36,004 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36317 2023-02-15 21:01:36,004 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36317 2023-02-15 21:01:36,015 INFO [Listener at localhost/34059] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:36,015 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:36,015 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:36,015 INFO [Listener at localhost/34059] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:36,015 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:36,015 INFO [Listener at localhost/34059] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:36,016 INFO [Listener at localhost/34059] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:36,018 INFO [Listener at localhost/34059] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37719 2023-02-15 21:01:36,018 INFO [Listener at localhost/34059] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:36,020 DEBUG [Listener at localhost/34059] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:36,020 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:36,021 INFO [Listener at localhost/34059] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:36,022 INFO [Listener at localhost/34059] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37719 connecting to ZooKeeper ensemble=127.0.0.1:54640 2023-02-15 21:01:36,026 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:377190x0, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:36,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37719-0x10059c9e4ef0002 connected 2023-02-15 21:01:36,029 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:36,029 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:36,031 DEBUG [Listener at localhost/34059] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:36,032 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37719 2023-02-15 21:01:36,032 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37719 2023-02-15 21:01:36,036 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37719 2023-02-15 21:01:36,036 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37719 2023-02-15 21:01:36,036 DEBUG [Listener at localhost/34059] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37719 2023-02-15 21:01:36,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,039 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:36,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,042 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:36,042 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:36,042 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:36,043 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:36,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45209,1676494895934 from backup master directory 2023-02-15 21:01:36,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:36,046 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,046 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:36,046 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:36,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/hbase.id with ID: 8331e857-a000-4a76-bdba-7a57fddc8ed3 2023-02-15 21:01:36,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:36,072 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5700cb11 to 127.0.0.1:54640 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:36,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95df588, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:36,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:36,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:36,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:36,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store-tmp 2023-02-15 21:01:36,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:36,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:36,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:36,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:36,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:36,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:36,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:36,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/WALs/jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45209%2C1676494895934, suffix=, logDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/WALs/jenkins-hbase4.apache.org,45209,1676494895934, archiveDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:36,117 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK] 2023-02-15 21:01:36,118 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK] 2023-02-15 21:01:36,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/WALs/jenkins-hbase4.apache.org,45209,1676494895934/jenkins-hbase4.apache.org%2C45209%2C1676494895934.1676494896101 2023-02-15 21:01:36,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK], DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK]] 2023-02-15 21:01:36,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:36,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:36,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:36,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:36,123 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:36,124 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:36,124 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:36,125 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:36,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:36,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:36,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71994992, jitterRate=0.07280898094177246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:36,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:36,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:36,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:36,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:36,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:36,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 21:01:36,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 21:01:36,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:36,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:36,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:36,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:36,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:36,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:36,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:36,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:36,182 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:36,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:36,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:36,185 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:36,185 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:36,185 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:36,185 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45209,1676494895934, sessionid=0x10059c9e4ef0000, setting cluster-up flag (Was=false) 2023-02-15 21:01:36,189 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:36,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,197 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:36,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:36,201 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.hbase-snapshot/.tmp 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:36,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494926204 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:36,205 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:36,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,205 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:36,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:36,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:36,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:36,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:36,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:36,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494896207,5,FailOnTimeoutGroup] 2023-02-15 21:01:36,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494896207,5,FailOnTimeoutGroup] 2023-02-15 21:01:36,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:36,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,207 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:36,219 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:36,220 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:36,220 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0 2023-02-15 21:01:36,229 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:36,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:36,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/info 2023-02-15 21:01:36,233 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:36,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:36,235 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:36,235 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:36,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:36,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/table 2023-02-15 21:01:36,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:36,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,238 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740 2023-02-15 21:01:36,238 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740 2023-02-15 21:01:36,240 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:36,241 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:36,242 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:36,243 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61728844, jitterRate=-0.08016854524612427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:36,243 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:36,243 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:36,243 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:36,243 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:36,243 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:36,243 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:36,243 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:36,243 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:36,244 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:36,244 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:36,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:36,246 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:36,247 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:36,264 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(952): ClusterId : 8331e857-a000-4a76-bdba-7a57fddc8ed3 2023-02-15 21:01:36,264 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(952): ClusterId : 8331e857-a000-4a76-bdba-7a57fddc8ed3 2023-02-15 21:01:36,264 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:36,264 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:36,267 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:36,267 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:36,267 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:36,267 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:36,270 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:36,271 DEBUG [RS:1;jenkins-hbase4:37719] zookeeper.ReadOnlyZKClient(139): Connect 0x45c1c613 to 127.0.0.1:54640 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:36,271 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:36,272 DEBUG [RS:0;jenkins-hbase4:36317] zookeeper.ReadOnlyZKClient(139): Connect 0x175ad87b to 127.0.0.1:54640 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:36,277 DEBUG [RS:1;jenkins-hbase4:37719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b0630db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:36,278 DEBUG [RS:1;jenkins-hbase4:37719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f39ad63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:36,278 DEBUG [RS:0;jenkins-hbase4:36317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@199d34e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:36,278 DEBUG [RS:0;jenkins-hbase4:36317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1da2b30b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:36,286 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37719 2023-02-15 21:01:36,286 INFO [RS:1;jenkins-hbase4:37719] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:36,286 INFO [RS:1;jenkins-hbase4:37719] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:36,286 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:36,287 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45209,1676494895934 with isa=jenkins-hbase4.apache.org/172.31.14.131:37719, startcode=1676494896015 2023-02-15 21:01:36,287 DEBUG [RS:1;jenkins-hbase4:37719] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:36,288 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45599, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:36,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,290 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0 2023-02-15 21:01:36,290 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37671 2023-02-15 21:01:36,290 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:36,290 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36317 2023-02-15 21:01:36,290 INFO [RS:0;jenkins-hbase4:36317] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:36,290 INFO [RS:0;jenkins-hbase4:36317] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:36,291 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:36,291 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:36,292 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45209,1676494895934 with isa=jenkins-hbase4.apache.org/172.31.14.131:36317, startcode=1676494895988 2023-02-15 21:01:36,292 DEBUG [RS:0;jenkins-hbase4:36317] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:36,292 DEBUG [RS:1;jenkins-hbase4:37719] zookeeper.ZKUtil(162): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,292 WARN [RS:1;jenkins-hbase4:37719] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:36,292 INFO [RS:1;jenkins-hbase4:37719] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:36,292 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,292 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37719,1676494896015] 2023-02-15 21:01:36,295 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46517, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:36,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,296 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0 2023-02-15 21:01:36,296 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37671 2023-02-15 21:01:36,297 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:36,297 DEBUG [RS:1;jenkins-hbase4:37719] zookeeper.ZKUtil(162): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,300 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:36,300 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:36,300 DEBUG [RS:0;jenkins-hbase4:36317] zookeeper.ZKUtil(162): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,300 WARN [RS:0;jenkins-hbase4:36317] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:36,300 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36317,1676494895988] 2023-02-15 21:01:36,300 INFO [RS:0;jenkins-hbase4:36317] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:36,300 DEBUG [RS:1;jenkins-hbase4:37719] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:36,301 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,301 INFO [RS:1;jenkins-hbase4:37719] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:36,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,304 INFO [RS:1;jenkins-hbase4:37719] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:36,304 INFO [RS:1;jenkins-hbase4:37719] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:36,304 DEBUG [RS:0;jenkins-hbase4:36317] zookeeper.ZKUtil(162): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,304 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,305 DEBUG [RS:0;jenkins-hbase4:36317] zookeeper.ZKUtil(162): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,305 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:36,305 INFO [RS:0;jenkins-hbase4:36317] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:36,308 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:36,308 INFO [RS:0;jenkins-hbase4:36317] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:36,309 INFO [RS:0;jenkins-hbase4:36317] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:36,309 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,309 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,309 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 DEBUG [RS:1;jenkins-hbase4:37719] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,310 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,311 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,311 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,311 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,311 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,311 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,311 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,312 DEBUG [RS:0;jenkins-hbase4:36317] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:36,316 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,316 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,317 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,325 INFO [RS:1;jenkins-hbase4:37719] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:36,326 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37719,1676494896015-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,330 INFO [RS:0;jenkins-hbase4:36317] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:36,330 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36317,1676494895988-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,342 INFO [RS:1;jenkins-hbase4:37719] regionserver.Replication(203): jenkins-hbase4.apache.org,37719,1676494896015 started 2023-02-15 21:01:36,343 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37719,1676494896015, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37719, sessionid=0x10059c9e4ef0002 2023-02-15 21:01:36,343 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:36,343 DEBUG [RS:1;jenkins-hbase4:37719] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,343 DEBUG [RS:1;jenkins-hbase4:37719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37719,1676494896015' 2023-02-15 21:01:36,343 DEBUG [RS:1;jenkins-hbase4:37719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:36,343 DEBUG [RS:1;jenkins-hbase4:37719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:36,343 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:36,344 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:36,344 DEBUG [RS:1;jenkins-hbase4:37719] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:36,344 DEBUG [RS:1;jenkins-hbase4:37719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37719,1676494896015' 2023-02-15 21:01:36,344 DEBUG [RS:1;jenkins-hbase4:37719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:36,344 DEBUG [RS:1;jenkins-hbase4:37719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:36,344 DEBUG [RS:1;jenkins-hbase4:37719] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:36,344 INFO [RS:1;jenkins-hbase4:37719] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:36,344 INFO [RS:1;jenkins-hbase4:37719] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:36,345 INFO [RS:0;jenkins-hbase4:36317] regionserver.Replication(203): jenkins-hbase4.apache.org,36317,1676494895988 started 2023-02-15 21:01:36,345 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36317,1676494895988, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36317, sessionid=0x10059c9e4ef0001 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36317,1676494895988' 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36317,1676494895988' 2023-02-15 21:01:36,345 DEBUG [RS:0;jenkins-hbase4:36317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:36,346 DEBUG [RS:0;jenkins-hbase4:36317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:36,346 DEBUG [RS:0;jenkins-hbase4:36317] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:36,346 INFO [RS:0;jenkins-hbase4:36317] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:36,346 INFO [RS:0;jenkins-hbase4:36317] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:36,397 DEBUG [jenkins-hbase4:45209] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:36,397 DEBUG [jenkins-hbase4:45209] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:36,399 DEBUG [jenkins-hbase4:45209] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:36,399 DEBUG [jenkins-hbase4:45209] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:36,399 DEBUG [jenkins-hbase4:45209] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:36,400 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36317,1676494895988, state=OPENING 2023-02-15 21:01:36,401 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:36,402 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:36,403 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:36,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36317,1676494895988}] 2023-02-15 21:01:36,557 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,557 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:36,559 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:36,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:36,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:36,565 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36317%2C1676494895988.meta, suffix=.meta, logDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,36317,1676494895988, archiveDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/oldWALs, maxLogs=32 2023-02-15 21:01:36,582 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK] 2023-02-15 21:01:36,582 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK] 2023-02-15 21:01:36,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,36317,1676494895988/jenkins-hbase4.apache.org%2C36317%2C1676494895988.meta.1676494896566.meta 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK], DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK]] 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:36,585 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:36,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:36,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:36,590 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/info 2023-02-15 21:01:36,590 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/info 2023-02-15 21:01:36,590 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:36,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:36,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:36,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:36,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:36,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,592 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:36,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/table 2023-02-15 21:01:36,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/table 2023-02-15 21:01:36,593 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:36,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740 2023-02-15 21:01:36,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740 2023-02-15 21:01:36,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:36,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:36,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63827585, jitterRate=-0.048894867300987244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:36,599 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:36,600 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494896557 2023-02-15 21:01:36,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:36,604 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:36,605 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36317,1676494895988, state=OPEN 2023-02-15 21:01:36,607 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:36,607 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:36,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:36,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36317,1676494895988 in 204 msec 2023-02-15 21:01:36,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:36,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-15 21:01:36,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 409 msec 2023-02-15 21:01:36,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494896613, completionTime=-1 2023-02-15 21:01:36,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:36,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:36,616 DEBUG [hconnection-0x2c3cdd9d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:36,618 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:36,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:36,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494956620 2023-02-15 21:01:36,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676495016620 2023-02-15 21:01:36,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45209,1676494895934-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45209,1676494895934-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45209,1676494895934-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45209, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:36,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:36,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:36,629 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:36,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:36,630 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:36,632 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/hbase/namespace/198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,632 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/hbase/namespace/198064a95a43b0f92165bc596a63d141 empty. 2023-02-15 21:01:36,633 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/hbase/namespace/198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:36,643 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:36,644 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 198064a95a43b0f92165bc596a63d141, NAME => 'hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp 2023-02-15 21:01:36,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:36,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 198064a95a43b0f92165bc596a63d141, disabling compactions & flushes 2023-02-15 21:01:36,650 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:36,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:36,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. after waiting 0 ms 2023-02-15 21:01:36,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:36,650 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:36,650 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 198064a95a43b0f92165bc596a63d141: 2023-02-15 21:01:36,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:36,653 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494896653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494896653"}]},"ts":"1676494896653"} 2023-02-15 21:01:36,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:36,656 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:36,656 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494896656"}]},"ts":"1676494896656"} 2023-02-15 21:01:36,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:36,661 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:36,662 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:36,662 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:36,662 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:36,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=198064a95a43b0f92165bc596a63d141, ASSIGN}] 2023-02-15 21:01:36,665 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=198064a95a43b0f92165bc596a63d141, ASSIGN 2023-02-15 21:01:36,665 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=198064a95a43b0f92165bc596a63d141, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36317,1676494895988; forceNewPlan=false, retain=false 2023-02-15 21:01:36,816 INFO [jenkins-hbase4:45209] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:36,817 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=198064a95a43b0f92165bc596a63d141, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:36,817 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494896817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494896817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494896817"}]},"ts":"1676494896817"} 2023-02-15 21:01:36,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 198064a95a43b0f92165bc596a63d141, server=jenkins-hbase4.apache.org,36317,1676494895988}] 2023-02-15 21:01:36,974 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:36,975 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36317%2C1676494895988, suffix=, logDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,36317,1676494895988, archiveDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/oldWALs, maxLogs=32 2023-02-15 21:01:36,991 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK] 2023-02-15 21:01:36,992 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK] 2023-02-15 21:01:36,994 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,36317,1676494895988/jenkins-hbase4.apache.org%2C36317%2C1676494895988.1676494896976 2023-02-15 21:01:36,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK], DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK]] 2023-02-15 21:01:36,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 198064a95a43b0f92165bc596a63d141, NAME => 'hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:36,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:36,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,995 INFO [StoreOpener-198064a95a43b0f92165bc596a63d141-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,996 DEBUG [StoreOpener-198064a95a43b0f92165bc596a63d141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/info 2023-02-15 21:01:36,996 DEBUG [StoreOpener-198064a95a43b0f92165bc596a63d141-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/info 2023-02-15 21:01:36,997 INFO [StoreOpener-198064a95a43b0f92165bc596a63d141-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 198064a95a43b0f92165bc596a63d141 columnFamilyName info 2023-02-15 21:01:36,997 INFO [StoreOpener-198064a95a43b0f92165bc596a63d141-1] regionserver.HStore(310): Store=198064a95a43b0f92165bc596a63d141/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:36,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:36,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:37,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:37,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:37,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 198064a95a43b0f92165bc596a63d141; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71161812, jitterRate=0.06039363145828247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:37,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 198064a95a43b0f92165bc596a63d141: 2023-02-15 21:01:37,003 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141., pid=6, masterSystemTime=1676494896970 2023-02-15 21:01:37,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:37,005 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:37,005 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=198064a95a43b0f92165bc596a63d141, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:37,005 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494897005"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494897005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494897005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494897005"}]},"ts":"1676494897005"} 2023-02-15 21:01:37,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:37,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 198064a95a43b0f92165bc596a63d141, server=jenkins-hbase4.apache.org,36317,1676494895988 in 187 msec 2023-02-15 21:01:37,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:37,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=198064a95a43b0f92165bc596a63d141, ASSIGN in 346 msec 2023-02-15 21:01:37,010 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:37,010 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494897010"}]},"ts":"1676494897010"} 2023-02-15 21:01:37,012 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:37,014 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:37,015 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 387 msec 2023-02-15 21:01:37,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:37,030 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:37,030 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:37,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:37,041 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:37,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-15 21:01:37,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:37,062 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:37,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-15 21:01:37,072 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:37,074 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:37,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.028sec 2023-02-15 21:01:37,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:37,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:37,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:37,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45209,1676494895934-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:37,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45209,1676494895934-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:37,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:37,165 DEBUG [Listener at localhost/34059] zookeeper.ReadOnlyZKClient(139): Connect 0x2ad26dba to 127.0.0.1:54640 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:37,170 DEBUG [Listener at localhost/34059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@423e32a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:37,172 DEBUG [hconnection-0x4cd3cd7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:37,174 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49080, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:37,176 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:37,176 DEBUG [Listener at localhost/34059] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:37,178 DEBUG [Listener at localhost/34059] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:37,180 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:37,180 INFO [Listener at localhost/34059] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:37,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:37,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:37,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:51300 deadline: 1676494957180, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:37,181 INFO [Listener at localhost/34059] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 21:01:37,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:37,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:37,186 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:37,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-15 21:01:37,186 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:37,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:37,188 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,188 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 empty. 2023-02-15 21:01:37,189 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,189 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 21:01:37,198 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:37,199 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9cdece3378d80376c36a857d2e9de9c5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp 2023-02-15 21:01:37,205 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:37,205 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 9cdece3378d80376c36a857d2e9de9c5, disabling compactions & flushes 2023-02-15 21:01:37,205 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,205 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,205 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. after waiting 0 ms 2023-02-15 21:01:37,205 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,205 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,205 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 9cdece3378d80376c36a857d2e9de9c5: 2023-02-15 21:01:37,208 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:37,209 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676494897209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494897209"}]},"ts":"1676494897209"} 2023-02-15 21:01:37,210 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:37,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:37,211 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494897211"}]},"ts":"1676494897211"} 2023-02-15 21:01:37,213 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-15 21:01:37,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:37,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:37,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:37,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:37,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, ASSIGN}] 2023-02-15 21:01:37,220 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, ASSIGN 2023-02-15 21:01:37,221 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37719,1676494896015; forceNewPlan=false, retain=false 2023-02-15 21:01:37,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:37,346 INFO [RS:1;jenkins-hbase4:37719] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37719%2C1676494896015, suffix=, logDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,37719,1676494896015, archiveDir=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/oldWALs, maxLogs=32 2023-02-15 21:01:37,362 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK] 2023-02-15 21:01:37,362 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK] 2023-02-15 21:01:37,363 INFO [RS:1;jenkins-hbase4:37719] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/WALs/jenkins-hbase4.apache.org,37719,1676494896015/jenkins-hbase4.apache.org%2C37719%2C1676494896015.1676494897347 2023-02-15 21:01:37,364 DEBUG [RS:1;jenkins-hbase4:37719] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35613,DS-a9a542bc-65c9-4e3f-8021-5a8d70c0c1dd,DISK], DatanodeInfoWithStorage[127.0.0.1:33091,DS-630c8e4c-c5e6-48d1-b351-14a7bdad826b,DISK]] 2023-02-15 21:01:37,371 INFO [jenkins-hbase4:45209] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:37,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9cdece3378d80376c36a857d2e9de9c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:37,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676494897372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494897372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494897372"}]},"ts":"1676494897372"} 2023-02-15 21:01:37,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 9cdece3378d80376c36a857d2e9de9c5, server=jenkins-hbase4.apache.org,37719,1676494896015}] 2023-02-15 21:01:37,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:37,526 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:37,527 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:37,528 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:37,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9cdece3378d80376c36a857d2e9de9c5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:37,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:37,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,533 INFO [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,534 DEBUG [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1 2023-02-15 21:01:37,534 DEBUG [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1 2023-02-15 21:01:37,535 INFO [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cdece3378d80376c36a857d2e9de9c5 columnFamilyName f1 2023-02-15 21:01:37,535 INFO [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] regionserver.HStore(310): Store=9cdece3378d80376c36a857d2e9de9c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:37,535 INFO [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,536 DEBUG [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2 2023-02-15 21:01:37,536 DEBUG [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2 2023-02-15 21:01:37,537 INFO [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cdece3378d80376c36a857d2e9de9c5 columnFamilyName f2 2023-02-15 21:01:37,537 INFO [StoreOpener-9cdece3378d80376c36a857d2e9de9c5-1] regionserver.HStore(310): Store=9cdece3378d80376c36a857d2e9de9c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:37,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:37,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:37,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:37,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9cdece3378d80376c36a857d2e9de9c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60179528, jitterRate=-0.10325515270233154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:37,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9cdece3378d80376c36a857d2e9de9c5: 2023-02-15 21:01:37,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5., pid=12, masterSystemTime=1676494897526 2023-02-15 21:01:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,548 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=9cdece3378d80376c36a857d2e9de9c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:37,548 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676494897548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494897548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494897548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494897548"}]},"ts":"1676494897548"} 2023-02-15 21:01:37,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 21:01:37,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 9cdece3378d80376c36a857d2e9de9c5, server=jenkins-hbase4.apache.org,37719,1676494896015 in 175 msec 2023-02-15 21:01:37,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 21:01:37,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, ASSIGN in 333 msec 2023-02-15 21:01:37,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:37,553 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494897553"}]},"ts":"1676494897553"} 2023-02-15 21:01:37,554 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-15 21:01:37,557 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:37,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 374 msec 2023-02-15 21:01:37,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:37,792 INFO [Listener at localhost/34059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-15 21:01:37,792 DEBUG [Listener at localhost/34059] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-15 21:01:37,793 INFO [Listener at localhost/34059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:37,795 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-15 21:01:37,795 INFO [Listener at localhost/34059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:37,795 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-15 21:01:37,795 INFO [Listener at localhost/34059] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:37,814 DEBUG [hconnection-0x4cd3cd7-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:37,827 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:37,835 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37719] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:37,963 INFO [Listener at localhost/34059] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:37,963 INFO [Listener at localhost/34059] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:37,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 21:01:37,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494897965 (current time:1676494897965). 2023-02-15 21:01:37,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:37,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] zookeeper.ReadOnlyZKClient(139): Connect 0x5a76e5d2 to 127.0.0.1:54640 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:37,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d0c6e78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:37,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:37,974 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:37,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a76e5d2 to 127.0.0.1:54640 2023-02-15 21:01:37,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:37,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:37,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 21:01:37,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 21:01:37,979 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 21:01:37,980 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676495497980 2023-02-15 21:01:37,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-15 21:01:37,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:37,981 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:37,982 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:37,982 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-15 21:01:37,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 21:01:37,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-15 21:01:37,984 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 21:01:37,984 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676495497984 2023-02-15 21:01:37,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 21:01:37,994 INFO [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 21:01:37,994 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:37,995 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 21:01:37,995 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 21:01:37,995 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 21:01:37,996 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:37,997 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:37,997 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:37,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:37,997 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:37,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:37,997 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:37,997 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 21:01:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 21:01:37,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 21:01:38,000 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 21:01:38,000 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37719,1676494896015' joining acquired barrier for procedure (foo) in zk 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 21:01:38,005 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36317,1676494895988' joining acquired barrier for procedure (foo) in zk 2023-02-15 21:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,007 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:38,007 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,008 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:38,008 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,008 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37719,1676494896015' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 21:01:38,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d3e7ff7[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:38,009 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 21:01:38,009 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 21:01:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,012 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 21:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:38,012 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 21:01:38,012 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. started... 2023-02-15 21:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 21:01:38,012 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36317,1676494895988' in zk 2023-02-15 21:01:38,013 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9cdece3378d80376c36a857d2e9de9c5 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 21:01:38,014 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 21:01:38,014 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:38,014 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 21:01:38,033 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f1/975ef67f2e4844cd8a05ec8a19efed25 2023-02-15 21:01:38,064 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f2/669f5f6cbd4a4e29a8e97f3277efcb78 2023-02-15 21:01:38,070 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f1/975ef67f2e4844cd8a05ec8a19efed25 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/975ef67f2e4844cd8a05ec8a19efed25 2023-02-15 21:01:38,076 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/975ef67f2e4844cd8a05ec8a19efed25, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:38,077 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f2/669f5f6cbd4a4e29a8e97f3277efcb78 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/669f5f6cbd4a4e29a8e97f3277efcb78 2023-02-15 21:01:38,082 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:38,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 21:01:38,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:38,084 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/669f5f6cbd4a4e29a8e97f3277efcb78, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:38,084 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:38,085 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 9cdece3378d80376c36a857d2e9de9c5 in 72ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:38,085 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9cdece3378d80376c36a857d2e9de9c5: 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.' region-info for snapshot=foo 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/975ef67f2e4844cd8a05ec8a19efed25] hfiles 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/975ef67f2e4844cd8a05ec8a19efed25 for snapshot=foo 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/669f5f6cbd4a4e29a8e97f3277efcb78] hfiles 2023-02-15 21:01:38,086 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/669f5f6cbd4a4e29a8e97f3277efcb78 for snapshot=foo 2023-02-15 21:01:38,094 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. completed. 2023-02-15 21:01:38,094 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 21:01:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 21:01:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 21:01:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,37719,1676494896015' in zk 2023-02-15 21:01:38,096 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,096 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 21:01:38,096 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:38,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:38,097 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 21:01:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,37719,1676494896015': 2023-02-15 21:01:38,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37719,1676494896015' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 21:01:38,101 INFO [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 21:01:38,101 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:38,101 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:38,101 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 21:01:38,101 INFO [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:38,103 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,103 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:38,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:38,104 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:38,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,104 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,106 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:38,107 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:38,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:38,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:38,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:38,114 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:38,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 21:01:38,113 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:38,115 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 21:01:38,115 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,115 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,115 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:38,115 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:38,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:38,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:38,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.hbase-snapshot/.tmp/foo 2023-02-15 21:01:38,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:38,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.hbase-snapshot/.tmp/foo to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.hbase-snapshot/foo 2023-02-15 21:01:38,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-15 21:01:38,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.hbase-snapshot/.tmp/foo 2023-02-15 21:01:38,162 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.hbase-snapshot/.tmp/foo 2023-02-15 21:01:38,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676494897980Consolidate snapshot: foo at 1676494898114 (+134 ms)Loading Region manifests for foo at 1676494898115 (+1 ms)Writing data manifest for foo at 1676494898119 (+4 ms)Verifying snapshot: foo at 1676494898131 (+12 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676494898162 (+31 ms) 2023-02-15 21:01:38,164 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-15 21:01:38,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 183 msec 2023-02-15 21:01:38,284 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:38,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-15 21:01:38,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:38,286 INFO [Listener at localhost/34059] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:38,290 INFO [Listener at localhost/34059] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:38,296 INFO [Listener at localhost/34059] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:38,340 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37719] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,443 INFO [Listener at localhost/34059] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:38,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:38,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,452 INFO [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-15 21:01:38,452 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:38,453 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-15 21:01:38,453 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-15 21:01:38,454 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,454 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,455 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,455 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:38,455 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:38,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:38,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:38,455 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,455 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,457 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 21:01:38,457 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 21:01:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 21:01:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-15 21:01:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36317,1676494895988' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 21:01:38,461 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:38,462 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-15 21:01:38,462 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 21:01:38,462 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:38,462 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,462 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. started... 2023-02-15 21:01:38,462 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9cdece3378d80376c36a857d2e9de9c5 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 21:01:38,464 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,464 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,464 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:38,484 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f1/0159ae79e0284df3aeb56fce7a8c0bf2 2023-02-15 21:01:38,505 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f2/e17c580671664cc88eb54aa0fe76a17a 2023-02-15 21:01:38,511 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f1/0159ae79e0284df3aeb56fce7a8c0bf2 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/0159ae79e0284df3aeb56fce7a8c0bf2 2023-02-15 21:01:38,516 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/0159ae79e0284df3aeb56fce7a8c0bf2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:38,517 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/.tmp/f2/e17c580671664cc88eb54aa0fe76a17a as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/e17c580671664cc88eb54aa0fe76a17a 2023-02-15 21:01:38,521 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/e17c580671664cc88eb54aa0fe76a17a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:38,522 INFO [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 9cdece3378d80376c36a857d2e9de9c5 in 60ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:38,523 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9cdece3378d80376c36a857d2e9de9c5: 2023-02-15 21:01:38,523 DEBUG [rs(jenkins-hbase4.apache.org,37719,1676494896015)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 21:01:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 21:01:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-15 21:01:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37719,1676494896015' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-15 21:01:38,526 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,526 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,527 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:38,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:38,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37719,1676494896015' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-15 21:01:38,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5901f088[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:38,529 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-15 21:01:38,529 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,530 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,530 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 21:01:38,531 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,531 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 21:01:38,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,37719,1676494896015' in zk 2023-02-15 21:01:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-15 21:01:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-15 21:01:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,36317,1676494895988' in zk 2023-02-15 21:01:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 21:01:38,532 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:38,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:38,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,37719,1676494896015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 21:01:38,534 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-15 21:01:38,534 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:38,534 DEBUG [member: 'jenkins-hbase4.apache.org,36317,1676494895988' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-15 21:01:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:38,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,37719,1676494896015': 2023-02-15 21:01:38,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37719,1676494896015' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-15 21:01:38,537 INFO [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-15 21:01:38,537 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:38,537 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:38,537 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,537 INFO [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:38,541 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:38,541 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:38,541 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:38,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:38,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,541 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,542 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:38,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,543 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:38,544 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,546 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:38,546 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:38,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:38,546 DEBUG [(jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:38,546 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:38,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-15 21:01:38,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:01:38,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:38,546 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:38,546 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:38,546 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:38,547 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:38,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,548 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,648 DEBUG [Listener at localhost/34059] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:01:38,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:01:38,655 INFO [Listener at localhost/34059] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676494897965 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:38,656 DEBUG [Listener at localhost/34059] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37671/user/jenkins/test-data/2e63d023-14c6-f24c-80b9-b2f71cd278dd/foo/97580f2b-1508-48ae-bc26-2065b9935e19/data/default/testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,656 INFO [Listener at localhost/34059] snapshot.RestoreSnapshotHelper(239): region to add: 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:38,656 INFO [Listener at localhost/34059] snapshot.RestoreSnapshotHelper(585): clone region=9cdece3378d80376c36a857d2e9de9c5 as 9cdece3378d80376c36a857d2e9de9c5 in snapshot foo 2023-02-15 21:01:38,657 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9cdece3378d80376c36a857d2e9de9c5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37671/user/jenkins/test-data/2e63d023-14c6-f24c-80b9-b2f71cd278dd/foo/97580f2b-1508-48ae-bc26-2065b9935e19 2023-02-15 21:01:38,664 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:38,664 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 975ef67f2e4844cd8a05ec8a19efed25 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,667 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 669f5f6cbd4a4e29a8e97f3277efcb78 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 9cdece3378d80376c36a857d2e9de9c5, disabling compactions & flushes 2023-02-15 21:01:38,669 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. after waiting 0 ms 2023-02-15 21:01:38,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,669 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 9cdece3378d80376c36a857d2e9de9c5: 2023-02-15 21:01:38,669 INFO [Listener at localhost/34059] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676494897965 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:38,669 DEBUG [Listener at localhost/34059] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37671/user/jenkins/test-data/2e63d023-14c6-f24c-80b9-b2f71cd278dd/foo/97580f2b-1508-48ae-bc26-2065b9935e19 2023-02-15 21:01:38,669 DEBUG [Listener at localhost/34059] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37671/user/jenkins/test-data/2e63d023-14c6-f24c-80b9-b2f71cd278dd/foo/97580f2b-1508-48ae-bc26-2065b9935e19 2023-02-15 21:01:38,670 DEBUG [Listener at localhost/34059] util.CommonFSUtils(699): |-data/ 2023-02-15 21:01:38,670 DEBUG [Listener at localhost/34059] util.CommonFSUtils(699): |----default/ 2023-02-15 21:01:38,671 DEBUG [Listener at localhost/34059] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-15 21:01:38,671 DEBUG [Listener at localhost/34059] util.CommonFSUtils(699): |----------9cdece3378d80376c36a857d2e9de9c5/ 2023-02-15 21:01:38,671 DEBUG [Listener at localhost/34059] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:38,672 DEBUG [Listener at localhost/34059] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:38,672 DEBUG [Listener at localhost/34059] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=9cdece3378d80376c36a857d2e9de9c5-975ef67f2e4844cd8a05ec8a19efed25 2023-02-15 21:01:38,672 DEBUG [Listener at localhost/34059] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:38,672 DEBUG [Listener at localhost/34059] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=9cdece3378d80376c36a857d2e9de9c5-669f5f6cbd4a4e29a8e97f3277efcb78 2023-02-15 21:01:38,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-15 21:01:38,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 21:01:38,677 INFO [Listener at localhost/34059] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:38,681 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494898681"}]},"ts":"1676494898681"} 2023-02-15 21:01:38,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-15 21:01:38,684 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-15 21:01:38,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, UNASSIGN}] 2023-02-15 21:01:38,686 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, UNASSIGN 2023-02-15 21:01:38,686 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9cdece3378d80376c36a857d2e9de9c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:38,686 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676494898686"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494898686"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494898686"}]},"ts":"1676494898686"} 2023-02-15 21:01:38,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 9cdece3378d80376c36a857d2e9de9c5, server=jenkins-hbase4.apache.org,37719,1676494896015}] 2023-02-15 21:01:38,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:38,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:38,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9cdece3378d80376c36a857d2e9de9c5, disabling compactions & flushes 2023-02-15 21:01:38,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. after waiting 0 ms 2023-02-15 21:01:38,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:38,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5. 2023-02-15 21:01:38,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9cdece3378d80376c36a857d2e9de9c5: 2023-02-15 21:01:38,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:38,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9cdece3378d80376c36a857d2e9de9c5, regionState=CLOSED 2023-02-15 21:01:38,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676494898850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494898850"}]},"ts":"1676494898850"} 2023-02-15 21:01:38,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 21:01:38,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 9cdece3378d80376c36a857d2e9de9c5, server=jenkins-hbase4.apache.org,37719,1676494896015 in 164 msec 2023-02-15 21:01:38,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 21:01:38,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=9cdece3378d80376c36a857d2e9de9c5, UNASSIGN in 169 msec 2023-02-15 21:01:38,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494898854"}]},"ts":"1676494898854"} 2023-02-15 21:01:38,856 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-15 21:01:38,857 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-15 21:01:38,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 181 msec 2023-02-15 21:01:38,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:38,984 INFO [Listener at localhost/34059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-15 21:01:38,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,987 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,988 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:38,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:01:38,991 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:38,993 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1, FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2, FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/recovered.edits] 2023-02-15 21:01:38,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/0159ae79e0284df3aeb56fce7a8c0bf2 to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/archive/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/0159ae79e0284df3aeb56fce7a8c0bf2 2023-02-15 21:01:38,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/975ef67f2e4844cd8a05ec8a19efed25 to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/archive/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f1/975ef67f2e4844cd8a05ec8a19efed25 2023-02-15 21:01:39,000 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/669f5f6cbd4a4e29a8e97f3277efcb78 to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/archive/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/669f5f6cbd4a4e29a8e97f3277efcb78 2023-02-15 21:01:39,001 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/e17c580671664cc88eb54aa0fe76a17a to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/archive/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/f2/e17c580671664cc88eb54aa0fe76a17a 2023-02-15 21:01:39,003 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/recovered.edits/12.seqid to hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/archive/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5/recovered.edits/12.seqid 2023-02-15 21:01:39,004 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/.tmp/data/default/testInitTableSnapshotMapperJobConfig/9cdece3378d80376c36a857d2e9de9c5 2023-02-15 21:01:39,004 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-15 21:01:39,006 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:39,008 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-15 21:01:39,009 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-15 21:01:39,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:39,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-15 21:01:39,010 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494899010"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:39,012 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 21:01:39,012 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9cdece3378d80376c36a857d2e9de9c5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676494897183.9cdece3378d80376c36a857d2e9de9c5.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 21:01:39,012 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-15 21:01:39,012 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676494899012"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:39,016 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-15 21:01:39,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-15 21:01:39,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-15 21:01:39,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45209] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:01:39,090 INFO [Listener at localhost/34059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-15 21:01:39,090 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:01:39,090 INFO [Listener at localhost/34059] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:01:39,091 DEBUG [Listener at localhost/34059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ad26dba to 127.0.0.1:54640 2023-02-15 21:01:39,091 DEBUG [Listener at localhost/34059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,091 DEBUG [Listener at localhost/34059] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:01:39,091 DEBUG [Listener at localhost/34059] util.JVMClusterUtil(257): Found active master hash=1352353821, stopped=false 2023-02-15 21:01:39,091 INFO [Listener at localhost/34059] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:39,093 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:39,093 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:39,093 INFO [Listener at localhost/34059] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:01:39,093 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:39,093 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:39,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:39,095 DEBUG [Listener at localhost/34059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5700cb11 to 127.0.0.1:54640 2023-02-15 21:01:39,095 DEBUG [Listener at localhost/34059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,095 INFO [Listener at localhost/34059] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36317,1676494895988' ***** 2023-02-15 21:01:39,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:39,095 INFO [Listener at localhost/34059] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:39,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:39,096 INFO [RS:0;jenkins-hbase4:36317] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:39,096 INFO [Listener at localhost/34059] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37719,1676494896015' ***** 2023-02-15 21:01:39,096 INFO [Listener at localhost/34059] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:39,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:39,096 INFO [RS:0;jenkins-hbase4:36317] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:39,097 INFO [RS:0;jenkins-hbase4:36317] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:39,097 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(3304): Received CLOSE for 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:39,097 INFO [RS:1;jenkins-hbase4:37719] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:39,098 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:39,098 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:39,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 198064a95a43b0f92165bc596a63d141, disabling compactions & flushes 2023-02-15 21:01:39,098 DEBUG [RS:0;jenkins-hbase4:36317] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x175ad87b to 127.0.0.1:54640 2023-02-15 21:01:39,098 INFO [RS:1;jenkins-hbase4:37719] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:39,100 DEBUG [RS:0;jenkins-hbase4:36317] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:39,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:39,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. after waiting 0 ms 2023-02-15 21:01:39,100 INFO [RS:0;jenkins-hbase4:36317] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:39,100 INFO [RS:0;jenkins-hbase4:36317] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:39,100 INFO [RS:0;jenkins-hbase4:36317] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:39,100 INFO [RS:1;jenkins-hbase4:37719] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:39,100 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:01:39,100 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:39,100 DEBUG [RS:1;jenkins-hbase4:37719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45c1c613 to 127.0.0.1:54640 2023-02-15 21:01:39,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:39,100 DEBUG [RS:1;jenkins-hbase4:37719] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 198064a95a43b0f92165bc596a63d141 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:01:39,100 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37719,1676494896015; all regions closed. 2023-02-15 21:01:39,108 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 21:01:39,108 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 198064a95a43b0f92165bc596a63d141=hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141.} 2023-02-15 21:01:39,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:39,109 DEBUG [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1505): Waiting on 1588230740, 198064a95a43b0f92165bc596a63d141 2023-02-15 21:01:39,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:39,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:39,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:39,109 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:39,109 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-15 21:01:39,114 DEBUG [RS:1;jenkins-hbase4:37719] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/oldWALs 2023-02-15 21:01:39,114 INFO [RS:1;jenkins-hbase4:37719] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37719%2C1676494896015:(num 1676494897347) 2023-02-15 21:01:39,114 DEBUG [RS:1;jenkins-hbase4:37719] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,114 INFO [RS:1;jenkins-hbase4:37719] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:39,114 INFO [RS:1;jenkins-hbase4:37719] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:39,114 INFO [RS:1;jenkins-hbase4:37719] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:39,114 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:39,114 INFO [RS:1;jenkins-hbase4:37719] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:39,114 INFO [RS:1;jenkins-hbase4:37719] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:39,115 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:39,115 INFO [RS:1;jenkins-hbase4:37719] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37719 2023-02-15 21:01:39,117 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:39,117 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:39,117 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:39,118 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37719,1676494896015] 2023-02-15 21:01:39,118 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37719,1676494896015; numProcessing=1 2023-02-15 21:01:39,119 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:39,119 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37719,1676494896015 already deleted, retry=false 2023-02-15 21:01:39,119 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37719,1676494896015 expired; onlineServers=1 2023-02-15 21:01:39,124 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37719,1676494896015 2023-02-15 21:01:39,125 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b0bfbd rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,125 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:39,125 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@754e86ec rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/.tmp/info/76394c406876471eafeb89194d224367 2023-02-15 21:01:39,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/.tmp/info/329fdbff7adf4065bd4191b088ff5b57 2023-02-15 21:01:39,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/.tmp/info/76394c406876471eafeb89194d224367 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/info/76394c406876471eafeb89194d224367 2023-02-15 21:01:39,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 329fdbff7adf4065bd4191b088ff5b57 2023-02-15 21:01:39,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/info/76394c406876471eafeb89194d224367, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:01:39,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 198064a95a43b0f92165bc596a63d141 in 44ms, sequenceid=6, compaction requested=false 2023-02-15 21:01:39,148 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/.tmp/rep_barrier/d43c079e68714c8faf2950f38828bfa7 2023-02-15 21:01:39,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/namespace/198064a95a43b0f92165bc596a63d141/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:01:39,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:39,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 198064a95a43b0f92165bc596a63d141: 2023-02-15 21:01:39,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494896627.198064a95a43b0f92165bc596a63d141. 2023-02-15 21:01:39,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d43c079e68714c8faf2950f38828bfa7 2023-02-15 21:01:39,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/.tmp/table/e3d8a6290c8a4ea5abfaa28d05f2a474 2023-02-15 21:01:39,163 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3d8a6290c8a4ea5abfaa28d05f2a474 2023-02-15 21:01:39,163 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/.tmp/info/329fdbff7adf4065bd4191b088ff5b57 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/info/329fdbff7adf4065bd4191b088ff5b57 2023-02-15 21:01:39,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 329fdbff7adf4065bd4191b088ff5b57 2023-02-15 21:01:39,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/info/329fdbff7adf4065bd4191b088ff5b57, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 21:01:39,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/.tmp/rep_barrier/d43c079e68714c8faf2950f38828bfa7 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/rep_barrier/d43c079e68714c8faf2950f38828bfa7 2023-02-15 21:01:39,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d43c079e68714c8faf2950f38828bfa7 2023-02-15 21:01:39,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/rep_barrier/d43c079e68714c8faf2950f38828bfa7, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 21:01:39,174 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/.tmp/table/e3d8a6290c8a4ea5abfaa28d05f2a474 as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/table/e3d8a6290c8a4ea5abfaa28d05f2a474 2023-02-15 21:01:39,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3d8a6290c8a4ea5abfaa28d05f2a474 2023-02-15 21:01:39,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/table/e3d8a6290c8a4ea5abfaa28d05f2a474, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 21:01:39,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 70ms, sequenceid=21, compaction requested=false 2023-02-15 21:01:39,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 21:01:39,184 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:39,184 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:39,184 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:39,184 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:39,293 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:39,293 INFO [RS:1;jenkins-hbase4:37719] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37719,1676494896015; zookeeper connection closed. 2023-02-15 21:01:39,293 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d2bff6f rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,296 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b5947c8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b5947c8 2023-02-15 21:01:39,296 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:37719-0x10059c9e4ef0002, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:39,296 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@24dad177 rejected from java.util.concurrent.ThreadPoolExecutor@8f2bf3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,309 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36317,1676494895988; all regions closed. 2023-02-15 21:01:39,315 DEBUG [RS:0;jenkins-hbase4:36317] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/oldWALs 2023-02-15 21:01:39,315 INFO [RS:0;jenkins-hbase4:36317] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36317%2C1676494895988.meta:.meta(num 1676494896566) 2023-02-15 21:01:39,319 DEBUG [RS:0;jenkins-hbase4:36317] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/oldWALs 2023-02-15 21:01:39,319 INFO [RS:0;jenkins-hbase4:36317] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36317%2C1676494895988:(num 1676494896976) 2023-02-15 21:01:39,319 DEBUG [RS:0;jenkins-hbase4:36317] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,319 INFO [RS:0;jenkins-hbase4:36317] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:39,319 INFO [RS:0;jenkins-hbase4:36317] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:39,319 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:39,320 INFO [RS:0;jenkins-hbase4:36317] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36317 2023-02-15 21:01:39,321 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36317,1676494895988 2023-02-15 21:01:39,321 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:39,321 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22ebd699 rejected from java.util.concurrent.ThreadPoolExecutor@26d4561c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,322 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36317,1676494895988] 2023-02-15 21:01:39,322 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36317,1676494895988; numProcessing=2 2023-02-15 21:01:39,324 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36317,1676494895988 already deleted, retry=false 2023-02-15 21:01:39,324 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36317,1676494895988 expired; onlineServers=0 2023-02-15 21:01:39,324 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45209,1676494895934' ***** 2023-02-15 21:01:39,324 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:01:39,324 DEBUG [M:0;jenkins-hbase4:45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54a4d6d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:39,325 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45209,1676494895934 2023-02-15 21:01:39,325 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45209,1676494895934; all regions closed. 2023-02-15 21:01:39,325 DEBUG [M:0;jenkins-hbase4:45209] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:39,325 DEBUG [M:0;jenkins-hbase4:45209] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:01:39,325 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:01:39,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494896207] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494896207,5,FailOnTimeoutGroup] 2023-02-15 21:01:39,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494896207] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494896207,5,FailOnTimeoutGroup] 2023-02-15 21:01:39,325 DEBUG [M:0;jenkins-hbase4:45209] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:01:39,326 INFO [M:0;jenkins-hbase4:45209] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:01:39,326 INFO [M:0;jenkins-hbase4:45209] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:01:39,326 INFO [M:0;jenkins-hbase4:45209] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:01:39,327 DEBUG [M:0;jenkins-hbase4:45209] master.HMaster(1512): Stopping service threads 2023-02-15 21:01:39,327 INFO [M:0;jenkins-hbase4:45209] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:01:39,327 ERROR [M:0;jenkins-hbase4:45209] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 21:01:39,327 INFO [M:0;jenkins-hbase4:45209] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:01:39,327 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:01:39,329 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:39,329 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:39,329 DEBUG [M:0;jenkins-hbase4:45209] zookeeper.ZKUtil(398): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:01:39,329 WARN [M:0;jenkins-hbase4:45209] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:01:39,329 INFO [M:0;jenkins-hbase4:45209] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:01:39,329 INFO [M:0;jenkins-hbase4:45209] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:01:39,330 DEBUG [M:0;jenkins-hbase4:45209] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:39,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:39,330 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:39,330 DEBUG [M:0;jenkins-hbase4:45209] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:39,330 DEBUG [M:0;jenkins-hbase4:45209] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:39,330 DEBUG [M:0;jenkins-hbase4:45209] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:39,330 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.90 KB heapSize=66.84 KB 2023-02-15 21:01:39,339 INFO [M:0;jenkins-hbase4:45209] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.90 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/490b84d2e5d24c03a0cdac9fc44def8e 2023-02-15 21:01:39,344 DEBUG [M:0;jenkins-hbase4:45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/490b84d2e5d24c03a0cdac9fc44def8e as hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/490b84d2e5d24c03a0cdac9fc44def8e 2023-02-15 21:01:39,347 INFO [M:0;jenkins-hbase4:45209] regionserver.HStore(1080): Added hdfs://localhost:37671/user/jenkins/test-data/dbe9a11a-0671-ef3a-e5be-d0e8fa1c80e0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/490b84d2e5d24c03a0cdac9fc44def8e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 21:01:39,348 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegion(2947): Finished flush of dataSize ~55.90 KB/57240, heapSize ~66.82 KB/68424, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-15 21:01:39,349 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:39,349 DEBUG [M:0;jenkins-hbase4:45209] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:39,352 INFO [M:0;jenkins-hbase4:45209] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:01:39,352 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:39,353 INFO [M:0;jenkins-hbase4:45209] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45209 2023-02-15 21:01:39,354 DEBUG [M:0;jenkins-hbase4:45209] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45209,1676494895934 already deleted, retry=false 2023-02-15 21:01:39,694 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:39,694 INFO [M:0;jenkins-hbase4:45209] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45209,1676494895934; zookeeper connection closed. 2023-02-15 21:01:39,694 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d865f3a rejected from java.util.concurrent.ThreadPoolExecutor@19b9c852[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,695 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): master:45209-0x10059c9e4ef0000, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:39,695 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42fda507 rejected from java.util.concurrent.ThreadPoolExecutor@19b9c852[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,794 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:39,794 INFO [RS:0;jenkins-hbase4:36317] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36317,1676494895988; zookeeper connection closed. 2023-02-15 21:01:39,794 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2edc4ae9 rejected from java.util.concurrent.ThreadPoolExecutor@26d4561c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,794 DEBUG [Listener at localhost/34059-EventThread] zookeeper.ZKWatcher(600): regionserver:36317-0x10059c9e4ef0001, quorum=127.0.0.1:54640, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:39,794 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61caf621] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61caf621 2023-02-15 21:01:39,794 ERROR [Listener at localhost/34059-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@561fd640 rejected from java.util.concurrent.ThreadPoolExecutor@26d4561c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:39,795 INFO [Listener at localhost/34059] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:01:39,795 WARN [Listener at localhost/34059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:39,800 INFO [Listener at localhost/34059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:39,906 WARN [BP-1043695897-172.31.14.131-1676494895367 heartbeating to localhost/127.0.0.1:37671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:39,906 WARN [BP-1043695897-172.31.14.131-1676494895367 heartbeating to localhost/127.0.0.1:37671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1043695897-172.31.14.131-1676494895367 (Datanode Uuid 2adb20df-a9af-470d-9b86-a993d9d2b63d) service to localhost/127.0.0.1:37671 2023-02-15 21:01:39,906 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/dfs/data/data3/current/BP-1043695897-172.31.14.131-1676494895367] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:39,906 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/dfs/data/data4/current/BP-1043695897-172.31.14.131-1676494895367] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:39,908 WARN [Listener at localhost/34059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:39,911 INFO [Listener at localhost/34059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:40,016 WARN [BP-1043695897-172.31.14.131-1676494895367 heartbeating to localhost/127.0.0.1:37671] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:40,016 WARN [BP-1043695897-172.31.14.131-1676494895367 heartbeating to localhost/127.0.0.1:37671] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1043695897-172.31.14.131-1676494895367 (Datanode Uuid c4347a25-6b91-47ef-81c5-bf3e1e47794d) service to localhost/127.0.0.1:37671 2023-02-15 21:01:40,017 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/dfs/data/data1/current/BP-1043695897-172.31.14.131-1676494895367] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:40,017 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/cluster_da3e8939-d15e-5d36-b98c-9662dd9c7c3e/dfs/data/data2/current/BP-1043695897-172.31.14.131-1676494895367] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:40,028 INFO [Listener at localhost/34059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:40,147 INFO [Listener at localhost/34059] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:01:40,161 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:01:40,175 INFO [Listener at localhost/34059] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=181 (was 155) Potentially hanging thread: (jenkins-hbase4.apache.org,45209,1676494895934)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:37671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34059 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:37671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:37671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:37671 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:37671 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:37671 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=567 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 327), ProcessCount=166 (was 166), AvailableMemoryMB=2788 (was 2814) 2023-02-15 21:01:40,184 INFO [Listener at localhost/34059] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=181, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=166, AvailableMemoryMB=2788 2023-02-15 21:01:40,194 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/hadoop.log.dir so I do NOT create it in target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180 2023-02-15 21:01:40,194 WARN [Listener at localhost/34059] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 21:01:40,194 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/hadoop.tmp.dir so I do NOT create it in target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180 2023-02-15 21:01:40,194 WARN [Listener at localhost/34059] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e67349a-fff8-a1e0-1089-23f185bcb2f9/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 21:01:40,194 DEBUG [Listener at localhost/34059] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180 2023-02-15 21:01:40,194 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9, deleteOnExit=true 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/test.cache.data in system properties and HBase conf 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:40,195 DEBUG [Listener at localhost/34059] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:40,195 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:40,196 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:40,197 INFO [Listener at localhost/34059] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:40,200 WARN [Listener at localhost/34059] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:40,201 WARN [Listener at localhost/34059] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:40,237 WARN [Listener at localhost/34059] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:40,239 INFO [Listener at localhost/34059] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:40,243 INFO [Listener at localhost/34059] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/java.io.tmpdir/Jetty_localhost_43281_hdfs____6nt08m/webapp 2023-02-15 21:01:40,335 INFO [Listener at localhost/34059] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43281 2023-02-15 21:01:40,339 WARN [Listener at localhost/34059] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:40,340 WARN [Listener at localhost/34059] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:40,378 WARN [Listener at localhost/42911] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:40,391 WARN [Listener at localhost/42911] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:40,393 WARN [Listener at localhost/42911] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:40,394 INFO [Listener at localhost/42911] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:40,401 INFO [Listener at localhost/42911] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/java.io.tmpdir/Jetty_localhost_35231_datanode____.vj1wh7/webapp 2023-02-15 21:01:40,493 INFO [Listener at localhost/42911] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35231 2023-02-15 21:01:40,501 WARN [Listener at localhost/37883] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:40,522 WARN [Listener at localhost/37883] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:40,523 WARN [Listener at localhost/37883] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:40,524 INFO [Listener at localhost/37883] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:40,528 INFO [Listener at localhost/37883] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/java.io.tmpdir/Jetty_localhost_34467_datanode____.rf2qsl/webapp 2023-02-15 21:01:40,599 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77cbdc237da8a1c: Processing first storage report for DS-35be7886-98f1-4ea6-92b8-ffd4181b920d from datanode 5e4faa00-a5ca-42cb-b0db-23040cca9975 2023-02-15 21:01:40,599 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77cbdc237da8a1c: from storage DS-35be7886-98f1-4ea6-92b8-ffd4181b920d node DatanodeRegistration(127.0.0.1:44141, datanodeUuid=5e4faa00-a5ca-42cb-b0db-23040cca9975, infoPort=39341, infoSecurePort=0, ipcPort=37883, storageInfo=lv=-57;cid=testClusterID;nsid=2034112430;c=1676494900203), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:40,599 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77cbdc237da8a1c: Processing first storage report for DS-cd5428e1-d1b5-42df-bac2-8eb1ba5d9c30 from datanode 5e4faa00-a5ca-42cb-b0db-23040cca9975 2023-02-15 21:01:40,599 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77cbdc237da8a1c: from storage DS-cd5428e1-d1b5-42df-bac2-8eb1ba5d9c30 node DatanodeRegistration(127.0.0.1:44141, datanodeUuid=5e4faa00-a5ca-42cb-b0db-23040cca9975, infoPort=39341, infoSecurePort=0, ipcPort=37883, storageInfo=lv=-57;cid=testClusterID;nsid=2034112430;c=1676494900203), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:40,631 INFO [Listener at localhost/37883] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34467 2023-02-15 21:01:40,638 WARN [Listener at localhost/45445] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:40,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cc157e476c158d1: Processing first storage report for DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8 from datanode 43d0ab47-fc7f-463d-afe6-70370e45065c 2023-02-15 21:01:40,735 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cc157e476c158d1: from storage DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8 node DatanodeRegistration(127.0.0.1:36665, datanodeUuid=43d0ab47-fc7f-463d-afe6-70370e45065c, infoPort=39527, infoSecurePort=0, ipcPort=45445, storageInfo=lv=-57;cid=testClusterID;nsid=2034112430;c=1676494900203), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:40,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8cc157e476c158d1: Processing first storage report for DS-28eaeea4-cff8-4cd2-883c-a735dd2e7fac from datanode 43d0ab47-fc7f-463d-afe6-70370e45065c 2023-02-15 21:01:40,735 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8cc157e476c158d1: from storage DS-28eaeea4-cff8-4cd2-883c-a735dd2e7fac node DatanodeRegistration(127.0.0.1:36665, datanodeUuid=43d0ab47-fc7f-463d-afe6-70370e45065c, infoPort=39527, infoSecurePort=0, ipcPort=45445, storageInfo=lv=-57;cid=testClusterID;nsid=2034112430;c=1676494900203), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:40,749 DEBUG [Listener at localhost/45445] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180 2023-02-15 21:01:40,751 INFO [Listener at localhost/45445] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/zookeeper_0, clientPort=51615, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:40,751 INFO [Listener at localhost/45445] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51615 2023-02-15 21:01:40,752 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,752 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,766 INFO [Listener at localhost/45445] util.FSUtils(479): Created version file at hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c with version=8 2023-02-15 21:01:40,766 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,767 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,768 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/hbase-staging 2023-02-15 21:01:40,769 INFO [Listener at localhost/45445] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:40,769 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,769 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,770 INFO [Listener at localhost/45445] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:40,770 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,770 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:40,770 INFO [Listener at localhost/45445] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:40,771 INFO [Listener at localhost/45445] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40009 2023-02-15 21:01:40,771 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,772 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,773 INFO [Listener at localhost/45445] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40009 connecting to ZooKeeper ensemble=127.0.0.1:51615 2023-02-15 21:01:40,782 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:400090x0, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:40,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40009-0x10059c9f7d30000 connected 2023-02-15 21:01:40,795 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:40,795 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:40,796 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:40,797 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40009 2023-02-15 21:01:40,798 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40009 2023-02-15 21:01:40,798 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40009 2023-02-15 21:01:40,800 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40009 2023-02-15 21:01:40,801 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40009 2023-02-15 21:01:40,802 INFO [Listener at localhost/45445] master.HMaster(444): hbase.rootdir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c, hbase.cluster.distributed=false 2023-02-15 21:01:40,813 INFO [Listener at localhost/45445] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:40,813 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,813 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,814 INFO [Listener at localhost/45445] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:40,814 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,814 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:40,814 INFO [Listener at localhost/45445] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:40,814 INFO [Listener at localhost/45445] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34297 2023-02-15 21:01:40,815 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:40,816 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:40,816 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,817 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,818 INFO [Listener at localhost/45445] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34297 connecting to ZooKeeper ensemble=127.0.0.1:51615 2023-02-15 21:01:40,822 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:342970x0, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:40,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34297-0x10059c9f7d30001 connected 2023-02-15 21:01:40,823 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:40,824 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:40,824 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:40,827 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34297 2023-02-15 21:01:40,832 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34297 2023-02-15 21:01:40,832 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34297 2023-02-15 21:01:40,832 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34297 2023-02-15 21:01:40,832 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34297 2023-02-15 21:01:40,843 INFO [Listener at localhost/45445] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:40,843 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,843 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,843 INFO [Listener at localhost/45445] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:40,843 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:40,844 INFO [Listener at localhost/45445] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:40,844 INFO [Listener at localhost/45445] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:40,844 INFO [Listener at localhost/45445] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33701 2023-02-15 21:01:40,845 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:40,845 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:40,846 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,847 INFO [Listener at localhost/45445] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,847 INFO [Listener at localhost/45445] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33701 connecting to ZooKeeper ensemble=127.0.0.1:51615 2023-02-15 21:01:40,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:337010x0, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:40,853 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): regionserver:337010x0, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:40,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33701-0x10059c9f7d30002 connected 2023-02-15 21:01:40,853 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:40,853 DEBUG [Listener at localhost/45445] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:40,856 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33701 2023-02-15 21:01:40,856 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33701 2023-02-15 21:01:40,861 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33701 2023-02-15 21:01:40,862 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33701 2023-02-15 21:01:40,862 DEBUG [Listener at localhost/45445] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33701 2023-02-15 21:01:40,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:40,864 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:40,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:40,867 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:40,867 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:40,867 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:40,867 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:40,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:40,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40009,1676494900769 from backup master directory 2023-02-15 21:01:40,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:40,870 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:40,870 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:40,870 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:40,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:40,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/hbase.id with ID: ded641d5-0b0f-439e-9a55-9ba44601944e 2023-02-15 21:01:40,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:40,896 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:40,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x53e4eec3 to 127.0.0.1:51615 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:40,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2928a059, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:40,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:40,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:40,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:40,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store-tmp 2023-02-15 21:01:40,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:40,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:40,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:40,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:40,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:40,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:40,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:40,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:40,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/WALs/jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:40,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40009%2C1676494900769, suffix=, logDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/WALs/jenkins-hbase4.apache.org,40009,1676494900769, archiveDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:40,952 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK] 2023-02-15 21:01:40,953 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK] 2023-02-15 21:01:40,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/WALs/jenkins-hbase4.apache.org,40009,1676494900769/jenkins-hbase4.apache.org%2C40009%2C1676494900769.1676494900928 2023-02-15 21:01:40,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK], DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK]] 2023-02-15 21:01:40,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:40,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:40,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:40,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:40,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:40,959 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:40,960 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:40,960 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:40,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:40,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:40,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:40,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:40,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65105709, jitterRate=-0.029849335551261902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:40,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:40,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:40,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:40,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:40,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:40,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 21:01:40,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 21:01:40,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:40,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:40,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:40,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:40,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:40,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:40,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:40,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:41,000 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:41,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:41,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:41,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:41,002 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:41,002 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:41,002 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:41,002 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:41,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40009,1676494900769, sessionid=0x10059c9f7d30000, setting cluster-up flag (Was=false) 2023-02-15 21:01:41,007 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:41,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:41,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:41,017 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:41,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:41,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:41,022 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.hbase-snapshot/.tmp 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:41,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494931033 2023-02-15 21:01:41,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:41,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:41,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:41,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:41,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:41,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:41,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,034 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:41,034 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:41,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:41,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:41,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:41,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:41,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:41,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494901035,5,FailOnTimeoutGroup] 2023-02-15 21:01:41,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494901035,5,FailOnTimeoutGroup] 2023-02-15 21:01:41,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:41,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,036 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:41,045 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:41,046 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:41,046 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c 2023-02-15 21:01:41,055 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:41,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:41,057 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/info 2023-02-15 21:01:41,058 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:41,058 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:41,060 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:41,060 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:41,061 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,061 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:41,062 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/table 2023-02-15 21:01:41,062 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:41,063 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,064 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(952): ClusterId : ded641d5-0b0f-439e-9a55-9ba44601944e 2023-02-15 21:01:41,064 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:41,065 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740 2023-02-15 21:01:41,066 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740 2023-02-15 21:01:41,067 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(952): ClusterId : ded641d5-0b0f-439e-9a55-9ba44601944e 2023-02-15 21:01:41,067 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:41,067 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:41,067 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:41,068 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:41,069 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:41,070 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:41,070 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:41,070 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:41,072 DEBUG [RS:0;jenkins-hbase4:34297] zookeeper.ReadOnlyZKClient(139): Connect 0x1a37ae55 to 127.0.0.1:51615 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:41,073 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:41,076 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:41,077 DEBUG [RS:1;jenkins-hbase4:33701] zookeeper.ReadOnlyZKClient(139): Connect 0x47011217 to 127.0.0.1:51615 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:41,078 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67110071, jitterRate=1.798570156097412E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:41,078 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:41,079 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:41,079 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:41,079 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:41,079 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:41,079 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:41,081 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:41,082 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:41,084 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:41,084 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:41,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:41,085 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:41,087 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:41,087 DEBUG [RS:0;jenkins-hbase4:34297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14f05363, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:41,087 DEBUG [RS:0;jenkins-hbase4:34297] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10cfc525, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:41,088 DEBUG [RS:1;jenkins-hbase4:33701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49c6f487, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:41,088 DEBUG [RS:1;jenkins-hbase4:33701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4df97967, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:41,096 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34297 2023-02-15 21:01:41,096 INFO [RS:0;jenkins-hbase4:34297] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:41,096 INFO [RS:0;jenkins-hbase4:34297] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:41,096 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:41,096 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40009,1676494900769 with isa=jenkins-hbase4.apache.org/172.31.14.131:34297, startcode=1676494900813 2023-02-15 21:01:41,097 DEBUG [RS:0;jenkins-hbase4:34297] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:41,098 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55895, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:41,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,100 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c 2023-02-15 21:01:41,100 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42911 2023-02-15 21:01:41,100 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:41,101 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33701 2023-02-15 21:01:41,101 INFO [RS:1;jenkins-hbase4:33701] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:41,101 INFO [RS:1;jenkins-hbase4:33701] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:41,101 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:41,101 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:41,102 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40009,1676494900769 with isa=jenkins-hbase4.apache.org/172.31.14.131:33701, startcode=1676494900842 2023-02-15 21:01:41,102 DEBUG [RS:0;jenkins-hbase4:34297] zookeeper.ZKUtil(162): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,102 WARN [RS:0;jenkins-hbase4:34297] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:41,102 DEBUG [RS:1;jenkins-hbase4:33701] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:41,102 INFO [RS:0;jenkins-hbase4:34297] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:41,102 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34297,1676494900813] 2023-02-15 21:01:41,102 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,105 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47687, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:41,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,106 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c 2023-02-15 21:01:41,106 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42911 2023-02-15 21:01:41,106 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:41,107 DEBUG [RS:0;jenkins-hbase4:34297] zookeeper.ZKUtil(162): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,107 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:41,110 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:41,110 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:41,110 DEBUG [RS:1;jenkins-hbase4:33701] zookeeper.ZKUtil(162): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,110 WARN [RS:1;jenkins-hbase4:33701] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:41,110 INFO [RS:1;jenkins-hbase4:33701] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:41,110 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:41,110 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,110 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33701,1676494900842] 2023-02-15 21:01:41,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,110 INFO [RS:0;jenkins-hbase4:34297] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:41,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,116 INFO [RS:0;jenkins-hbase4:34297] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:41,117 INFO [RS:0;jenkins-hbase4:34297] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:41,117 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,117 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:41,119 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:0;jenkins-hbase4:34297] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,119 DEBUG [RS:1;jenkins-hbase4:33701] zookeeper.ZKUtil(162): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,120 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,120 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,120 DEBUG [RS:1;jenkins-hbase4:33701] zookeeper.ZKUtil(162): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,120 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,121 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:41,121 INFO [RS:1;jenkins-hbase4:33701] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:41,123 INFO [RS:1;jenkins-hbase4:33701] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:41,123 INFO [RS:1;jenkins-hbase4:33701] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:41,123 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,123 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:41,124 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,125 DEBUG [RS:1;jenkins-hbase4:33701] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:41,132 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,132 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,132 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,132 INFO [RS:0;jenkins-hbase4:34297] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:41,132 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34297,1676494900813-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,142 INFO [RS:1;jenkins-hbase4:33701] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:41,143 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33701,1676494900842-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,143 INFO [RS:0;jenkins-hbase4:34297] regionserver.Replication(203): jenkins-hbase4.apache.org,34297,1676494900813 started 2023-02-15 21:01:41,143 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34297,1676494900813, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34297, sessionid=0x10059c9f7d30001 2023-02-15 21:01:41,143 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:41,143 DEBUG [RS:0;jenkins-hbase4:34297] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,143 DEBUG [RS:0;jenkins-hbase4:34297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34297,1676494900813' 2023-02-15 21:01:41,143 DEBUG [RS:0;jenkins-hbase4:34297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:41,143 DEBUG [RS:0;jenkins-hbase4:34297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34297,1676494900813' 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:41,144 DEBUG [RS:0;jenkins-hbase4:34297] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:41,144 INFO [RS:0;jenkins-hbase4:34297] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:41,144 INFO [RS:0;jenkins-hbase4:34297] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:41,153 INFO [RS:1;jenkins-hbase4:33701] regionserver.Replication(203): jenkins-hbase4.apache.org,33701,1676494900842 started 2023-02-15 21:01:41,153 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33701,1676494900842, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33701, sessionid=0x10059c9f7d30002 2023-02-15 21:01:41,153 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:41,153 DEBUG [RS:1;jenkins-hbase4:33701] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,153 DEBUG [RS:1;jenkins-hbase4:33701] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33701,1676494900842' 2023-02-15 21:01:41,153 DEBUG [RS:1;jenkins-hbase4:33701] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:41,153 DEBUG [RS:1;jenkins-hbase4:33701] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33701,1676494900842' 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:41,154 DEBUG [RS:1;jenkins-hbase4:33701] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:41,154 INFO [RS:1;jenkins-hbase4:33701] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:41,154 INFO [RS:1;jenkins-hbase4:33701] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:41,237 DEBUG [jenkins-hbase4:40009] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:41,237 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:41,239 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:41,239 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:41,239 DEBUG [jenkins-hbase4:40009] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:41,240 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33701,1676494900842, state=OPENING 2023-02-15 21:01:41,241 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:41,242 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:41,242 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:41,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:41,406 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:41,406 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:41,407 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49656, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:41,416 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:41,416 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:41,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33701%2C1676494900842.meta, suffix=.meta, logDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,33701,1676494900842, archiveDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/oldWALs, maxLogs=32 2023-02-15 21:01:41,436 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK] 2023-02-15 21:01:41,438 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK] 2023-02-15 21:01:41,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,33701,1676494900842/jenkins-hbase4.apache.org%2C33701%2C1676494900842.meta.1676494901418.meta 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK], DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK]] 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:41,440 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:41,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:41,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:41,442 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/info 2023-02-15 21:01:41,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/info 2023-02-15 21:01:41,443 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:41,443 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:41,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:41,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:41,445 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:41,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:41,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/table 2023-02-15 21:01:41,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/table 2023-02-15 21:01:41,446 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:41,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740 2023-02-15 21:01:41,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740 2023-02-15 21:01:41,450 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:41,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:41,452 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64815285, jitterRate=-0.034176990389823914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:41,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:41,453 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494901406 2023-02-15 21:01:41,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:41,458 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:41,458 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33701,1676494900842, state=OPEN 2023-02-15 21:01:41,460 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:41,460 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:41,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:41,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33701,1676494900842 in 218 msec 2023-02-15 21:01:41,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:41,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 377 msec 2023-02-15 21:01:41,465 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 442 msec 2023-02-15 21:01:41,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494901465, completionTime=-1 2023-02-15 21:01:41,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:41,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:41,468 DEBUG [hconnection-0x31c54fb6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:41,470 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494961471 2023-02-15 21:01:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676495021471 2023-02-15 21:01:41,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-15 21:01:41,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1676494900769-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1676494900769-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1676494900769-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40009, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:41,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:41,480 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:41,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:41,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:41,483 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,484 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e empty. 2023-02-15 21:01:41,484 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:41,501 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:41,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 760cdf8c5717711ed6e73dc1ce33693e, NAME => 'hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:41,515 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:41,515 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 760cdf8c5717711ed6e73dc1ce33693e, disabling compactions & flushes 2023-02-15 21:01:41,515 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,515 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,515 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. after waiting 0 ms 2023-02-15 21:01:41,515 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,515 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,515 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 760cdf8c5717711ed6e73dc1ce33693e: 2023-02-15 21:01:41,517 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:41,518 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494901518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494901518"}]},"ts":"1676494901518"} 2023-02-15 21:01:41,521 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:41,522 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:41,522 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494901522"}]},"ts":"1676494901522"} 2023-02-15 21:01:41,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:41,527 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:41,527 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:41,527 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:41,527 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:41,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=760cdf8c5717711ed6e73dc1ce33693e, ASSIGN}] 2023-02-15 21:01:41,532 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=760cdf8c5717711ed6e73dc1ce33693e, ASSIGN 2023-02-15 21:01:41,533 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=760cdf8c5717711ed6e73dc1ce33693e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34297,1676494900813; forceNewPlan=false, retain=false 2023-02-15 21:01:41,683 INFO [jenkins-hbase4:40009] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:41,684 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=760cdf8c5717711ed6e73dc1ce33693e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494901684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494901684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494901684"}]},"ts":"1676494901684"} 2023-02-15 21:01:41,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 760cdf8c5717711ed6e73dc1ce33693e, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:41,839 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,839 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:41,841 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:41,844 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,847 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34297%2C1676494900813, suffix=, logDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,34297,1676494900813, archiveDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/oldWALs, maxLogs=32 2023-02-15 21:01:41,861 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK] 2023-02-15 21:01:41,861 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK] 2023-02-15 21:01:41,868 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,34297,1676494900813/jenkins-hbase4.apache.org%2C34297%2C1676494900813.1676494901847 2023-02-15 21:01:41,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK], DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK]] 2023-02-15 21:01:41,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 760cdf8c5717711ed6e73dc1ce33693e, NAME => 'hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:41,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:41,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,870 INFO [StoreOpener-760cdf8c5717711ed6e73dc1ce33693e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,871 DEBUG [StoreOpener-760cdf8c5717711ed6e73dc1ce33693e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/info 2023-02-15 21:01:41,871 DEBUG [StoreOpener-760cdf8c5717711ed6e73dc1ce33693e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/info 2023-02-15 21:01:41,872 INFO [StoreOpener-760cdf8c5717711ed6e73dc1ce33693e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 760cdf8c5717711ed6e73dc1ce33693e columnFamilyName info 2023-02-15 21:01:41,872 INFO [StoreOpener-760cdf8c5717711ed6e73dc1ce33693e-1] regionserver.HStore(310): Store=760cdf8c5717711ed6e73dc1ce33693e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:41,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,875 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:41,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:41,881 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 760cdf8c5717711ed6e73dc1ce33693e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67564093, jitterRate=0.006783440709114075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:41,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 760cdf8c5717711ed6e73dc1ce33693e: 2023-02-15 21:01:41,881 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e., pid=6, masterSystemTime=1676494901839 2023-02-15 21:01:41,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,887 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:41,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=760cdf8c5717711ed6e73dc1ce33693e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:41,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494901887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494901887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494901887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494901887"}]},"ts":"1676494901887"} 2023-02-15 21:01:41,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:41,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 760cdf8c5717711ed6e73dc1ce33693e, server=jenkins-hbase4.apache.org,34297,1676494900813 in 203 msec 2023-02-15 21:01:41,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:41,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=760cdf8c5717711ed6e73dc1ce33693e, ASSIGN in 369 msec 2023-02-15 21:01:41,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:41,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494901898"}]},"ts":"1676494901898"} 2023-02-15 21:01:41,899 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:41,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:41,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 424 msec 2023-02-15 21:01:41,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:41,982 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:41,982 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:41,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:41,986 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:41,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:41,997 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:42,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-15 21:01:42,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:42,019 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:42,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-15 21:01:42,035 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:42,038 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:42,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.168sec 2023-02-15 21:01:42,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:42,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:42,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:42,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1676494900769-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:42,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40009,1676494900769-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:42,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:42,066 DEBUG [Listener at localhost/45445] zookeeper.ReadOnlyZKClient(139): Connect 0x345e061f to 127.0.0.1:51615 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:42,071 DEBUG [Listener at localhost/45445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71227fdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:42,074 DEBUG [hconnection-0x5a4f50d1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:42,076 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49670, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:42,078 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:42,078 DEBUG [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:42,080 DEBUG [Listener at localhost/45445] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:42,085 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:42,086 INFO [Listener at localhost/45445] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 21:01:42,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-15 21:01:42,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:42,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:45608 deadline: 1676494962086, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-15 21:01:42,087 INFO [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-15 21:01:42,088 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 21:01:42,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:42,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:42,095 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:42,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:42,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-15 21:01:42,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,107 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,108 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 empty. 2023-02-15 21:01:42,108 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae empty. 2023-02-15 21:01:42,108 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 empty. 2023-02-15 21:01:42,109 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 empty. 2023-02-15 21:01:42,110 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 empty. 2023-02-15 21:01:42,110 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,110 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,110 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,110 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,110 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,111 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,111 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 empty. 2023-02-15 21:01:42,111 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf empty. 2023-02-15 21:01:42,112 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c empty. 2023-02-15 21:01:42,112 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee empty. 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 empty. 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,113 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,114 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 21:01:42,131 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:42,134 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => d639c76fe0fc5e2bc0d3271609b340ae, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,134 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 970373a8437ef2b109dfc2507dd6a0d5, NAME => 'testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,134 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 21b986cefae2cd41bcd81324d06c5c2c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,153 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,154 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 970373a8437ef2b109dfc2507dd6a0d5, disabling compactions & flushes 2023-02-15 21:01:42,154 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,154 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,154 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. after waiting 0 ms 2023-02-15 21:01:42,154 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,154 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,154 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:42,154 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => a28c2d004072829dbe8cd24902bb9bb4, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing d639c76fe0fc5e2bc0d3271609b340ae, disabling compactions & flushes 2023-02-15 21:01:42,156 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,156 INFO [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33701%2C1676494900842, suffix=, logDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,33701,1676494900842, archiveDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/oldWALs, maxLogs=32 2023-02-15 21:01:42,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. after waiting 0 ms 2023-02-15 21:01:42,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,156 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:42,157 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 146c7fea6672c9fa55fb9aa7aceef411, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,172 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK] 2023-02-15 21:01:42,172 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK] 2023-02-15 21:01:42,173 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,173 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing a28c2d004072829dbe8cd24902bb9bb4, disabling compactions & flushes 2023-02-15 21:01:42,174 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. after waiting 0 ms 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,174 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,174 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => a2e31c2d97427b77974af7210a896555, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 146c7fea6672c9fa55fb9aa7aceef411, disabling compactions & flushes 2023-02-15 21:01:42,174 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. after waiting 0 ms 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,174 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,174 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:42,175 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 089cc74c3fe3bd73174bb55c58db69a7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,176 INFO [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,33701,1676494900842/jenkins-hbase4.apache.org%2C33701%2C1676494900842.1676494902156 2023-02-15 21:01:42,176 DEBUG [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44141,DS-35be7886-98f1-4ea6-92b8-ffd4181b920d,DISK], DatanodeInfoWithStorage[127.0.0.1:36665,DS-c30ebca1-ed1a-4620-ba39-4d009a7f62d8,DISK]] 2023-02-15 21:01:42,196 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,196 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,196 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 089cc74c3fe3bd73174bb55c58db69a7, disabling compactions & flushes 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing a2e31c2d97427b77974af7210a896555, disabling compactions & flushes 2023-02-15 21:01:42,197 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,197 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. after waiting 0 ms 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,197 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. after waiting 0 ms 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,197 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,197 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:42,197 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 91131e8ea09e93c79e45bbbfa440ceaf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,198 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ae43ae4c6bae75378d1f4bf9e63ea1c3, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:42,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 91131e8ea09e93c79e45bbbfa440ceaf, disabling compactions & flushes 2023-02-15 21:01:42,205 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. after waiting 0 ms 2023-02-15 21:01:42,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,205 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:42,206 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 163fcfc537af2d5a53badc6fadb408ee, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp 2023-02-15 21:01:42,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing ae43ae4c6bae75378d1f4bf9e63ea1c3, disabling compactions & flushes 2023-02-15 21:01:42,208 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. after waiting 0 ms 2023-02-15 21:01:42,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,208 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,208 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:42,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 163fcfc537af2d5a53badc6fadb408ee, disabling compactions & flushes 2023-02-15 21:01:42,212 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. after waiting 0 ms 2023-02-15 21:01:42,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,212 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:42,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:42,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 21b986cefae2cd41bcd81324d06c5c2c, disabling compactions & flushes 2023-02-15 21:01:42,555 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. after waiting 0 ms 2023-02-15 21:01:42,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,555 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,555 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:42,557 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:42,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,558 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676494902089.a2e31c2d97427b77974af7210a896555.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494902558"}]},"ts":"1676494902558"} 2023-02-15 21:01:42,561 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-15 21:01:42,562 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:42,562 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494902562"}]},"ts":"1676494902562"} 2023-02-15 21:01:42,563 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-15 21:01:42,567 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:42,573 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:42,573 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:42,573 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:42,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, ASSIGN}] 2023-02-15 21:01:42,577 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, ASSIGN 2023-02-15 21:01:42,577 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, ASSIGN 2023-02-15 21:01:42,577 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, ASSIGN 2023-02-15 21:01:42,577 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, ASSIGN 2023-02-15 21:01:42,577 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34297,1676494900813; forceNewPlan=false, retain=false 2023-02-15 21:01:42,577 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33701,1676494900842; forceNewPlan=false, retain=false 2023-02-15 21:01:42,577 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33701,1676494900842; forceNewPlan=false, retain=false 2023-02-15 21:01:42,577 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34297,1676494900813; forceNewPlan=false, retain=false 2023-02-15 21:01:42,578 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, ASSIGN 2023-02-15 21:01:42,578 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, ASSIGN 2023-02-15 21:01:42,578 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, ASSIGN 2023-02-15 21:01:42,578 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, ASSIGN 2023-02-15 21:01:42,578 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, ASSIGN 2023-02-15 21:01:42,578 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34297,1676494900813; forceNewPlan=false, retain=false 2023-02-15 21:01:42,579 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33701,1676494900842; forceNewPlan=false, retain=false 2023-02-15 21:01:42,579 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34297,1676494900813; forceNewPlan=false, retain=false 2023-02-15 21:01:42,579 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33701,1676494900842; forceNewPlan=false, retain=false 2023-02-15 21:01:42,579 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34297,1676494900813; forceNewPlan=false, retain=false 2023-02-15 21:01:42,579 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, ASSIGN 2023-02-15 21:01:42,580 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33701,1676494900842; forceNewPlan=false, retain=false 2023-02-15 21:01:42,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:42,728 INFO [jenkins-hbase4:40009] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-15 21:01:42,733 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=163fcfc537af2d5a53badc6fadb408ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,734 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=970373a8437ef2b109dfc2507dd6a0d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,733 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a28c2d004072829dbe8cd24902bb9bb4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,734 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494902733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902733"}]},"ts":"1676494902733"} 2023-02-15 21:01:42,733 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=089cc74c3fe3bd73174bb55c58db69a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902733"}]},"ts":"1676494902733"} 2023-02-15 21:01:42,734 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902733"}]},"ts":"1676494902733"} 2023-02-15 21:01:42,734 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494902733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902733"}]},"ts":"1676494902733"} 2023-02-15 21:01:42,734 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=91131e8ea09e93c79e45bbbfa440ceaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902733"}]},"ts":"1676494902733"} 2023-02-15 21:01:42,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 163fcfc537af2d5a53badc6fadb408ee, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:42,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure a28c2d004072829dbe8cd24902bb9bb4, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:42,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 089cc74c3fe3bd73174bb55c58db69a7, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:42,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 970373a8437ef2b109dfc2507dd6a0d5, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:42,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 91131e8ea09e93c79e45bbbfa440ceaf, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:42,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=21b986cefae2cd41bcd81324d06c5c2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902738"}]},"ts":"1676494902738"} 2023-02-15 21:01:42,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 21b986cefae2cd41bcd81324d06c5c2c, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:42,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ae43ae4c6bae75378d1f4bf9e63ea1c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902741"}]},"ts":"1676494902741"} 2023-02-15 21:01:42,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=146c7fea6672c9fa55fb9aa7aceef411, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,741 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902741"}]},"ts":"1676494902741"} 2023-02-15 21:01:42,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure ae43ae4c6bae75378d1f4bf9e63ea1c3, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:42,743 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d639c76fe0fc5e2bc0d3271609b340ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,743 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a2e31c2d97427b77974af7210a896555, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,743 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902743"}]},"ts":"1676494902743"} 2023-02-15 21:01:42,743 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676494902089.a2e31c2d97427b77974af7210a896555.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494902743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494902743"}]},"ts":"1676494902743"} 2023-02-15 21:01:42,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=15, state=RUNNABLE; OpenRegionProcedure 146c7fea6672c9fa55fb9aa7aceef411, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:42,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure d639c76fe0fc5e2bc0d3271609b340ae, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:42,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure a2e31c2d97427b77974af7210a896555, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:42,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 089cc74c3fe3bd73174bb55c58db69a7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-15 21:01:42,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,892 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,894 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1 2023-02-15 21:01:42,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 146c7fea6672c9fa55fb9aa7aceef411, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-15 21:01:42,894 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1 2023-02-15 21:01:42,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,894 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 089cc74c3fe3bd73174bb55c58db69a7 columnFamilyName f1 2023-02-15 21:01:42,895 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(310): Store=089cc74c3fe3bd73174bb55c58db69a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,895 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,895 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,896 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2 2023-02-15 21:01:42,896 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2 2023-02-15 21:01:42,896 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1 2023-02-15 21:01:42,896 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1 2023-02-15 21:01:42,896 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 089cc74c3fe3bd73174bb55c58db69a7 columnFamilyName f2 2023-02-15 21:01:42,897 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 146c7fea6672c9fa55fb9aa7aceef411 columnFamilyName f1 2023-02-15 21:01:42,897 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(310): Store=089cc74c3fe3bd73174bb55c58db69a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,897 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(310): Store=146c7fea6672c9fa55fb9aa7aceef411/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,897 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,898 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2 2023-02-15 21:01:42,898 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2 2023-02-15 21:01:42,898 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 146c7fea6672c9fa55fb9aa7aceef411 columnFamilyName f2 2023-02-15 21:01:42,899 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(310): Store=146c7fea6672c9fa55fb9aa7aceef411/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:42,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:42,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 089cc74c3fe3bd73174bb55c58db69a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67547755, jitterRate=0.006539985537528992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:42,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7., pid=23, masterSystemTime=1676494902887 2023-02-15 21:01:42,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 146c7fea6672c9fa55fb9aa7aceef411; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69826050, jitterRate=0.04048922657966614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:42,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:42,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 163fcfc537af2d5a53badc6fadb408ee, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-15 21:01:42,905 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=089cc74c3fe3bd73174bb55c58db69a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,905 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902905"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902905"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902905"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902905"}]},"ts":"1676494902905"} 2023-02-15 21:01:42,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411., pid=28, masterSystemTime=1676494902891 2023-02-15 21:01:42,906 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:42,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d639c76fe0fc5e2bc0d3271609b340ae, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-15 21:01:42,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,908 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=146c7fea6672c9fa55fb9aa7aceef411, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,908 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902908"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902908"}]},"ts":"1676494902908"} 2023-02-15 21:01:42,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-15 21:01:42,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 089cc74c3fe3bd73174bb55c58db69a7, server=jenkins-hbase4.apache.org,34297,1676494900813 in 170 msec 2023-02-15 21:01:42,909 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, ASSIGN in 335 msec 2023-02-15 21:01:42,910 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1 2023-02-15 21:01:42,910 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1 2023-02-15 21:01:42,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=15 2023-02-15 21:01:42,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=15, state=SUCCESS; OpenRegionProcedure 146c7fea6672c9fa55fb9aa7aceef411, server=jenkins-hbase4.apache.org,33701,1676494900842 in 166 msec 2023-02-15 21:01:42,910 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d639c76fe0fc5e2bc0d3271609b340ae columnFamilyName f1 2023-02-15 21:01:42,911 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(310): Store=d639c76fe0fc5e2bc0d3271609b340ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,911 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, ASSIGN in 337 msec 2023-02-15 21:01:42,912 DEBUG [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f1 2023-02-15 21:01:42,912 DEBUG [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f1 2023-02-15 21:01:42,912 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2 2023-02-15 21:01:42,912 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2 2023-02-15 21:01:42,912 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 163fcfc537af2d5a53badc6fadb408ee columnFamilyName f1 2023-02-15 21:01:42,912 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d639c76fe0fc5e2bc0d3271609b340ae columnFamilyName f2 2023-02-15 21:01:42,913 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(310): Store=163fcfc537af2d5a53badc6fadb408ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,913 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,913 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(310): Store=d639c76fe0fc5e2bc0d3271609b340ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,914 DEBUG [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f2 2023-02-15 21:01:42,914 DEBUG [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f2 2023-02-15 21:01:42,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,914 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 163fcfc537af2d5a53badc6fadb408ee columnFamilyName f2 2023-02-15 21:01:42,914 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(310): Store=163fcfc537af2d5a53badc6fadb408ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:42,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:42,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d639c76fe0fc5e2bc0d3271609b340ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61916899, jitterRate=-0.07736630737781525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:42,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae., pid=29, masterSystemTime=1676494902891 2023-02-15 21:01:42,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 163fcfc537af2d5a53badc6fadb408ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71422891, jitterRate=0.06428401172161102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:42,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee., pid=21, masterSystemTime=1676494902887 2023-02-15 21:01:42,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d639c76fe0fc5e2bc0d3271609b340ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902925"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902925"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902925"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902925"}]},"ts":"1676494902925"} 2023-02-15 21:01:42,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:42,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91131e8ea09e93c79e45bbbfa440ceaf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-15 21:01:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,926 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=163fcfc537af2d5a53badc6fadb408ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,926 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494902926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902926"}]},"ts":"1676494902926"} 2023-02-15 21:01:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:42,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a2e31c2d97427b77974af7210a896555, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-15 21:01:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-15 21:01:42,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure d639c76fe0fc5e2bc0d3271609b340ae, server=jenkins-hbase4.apache.org,33701,1676494900842 in 182 msec 2023-02-15 21:01:42,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-15 21:01:42,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 163fcfc537af2d5a53badc6fadb408ee, server=jenkins-hbase4.apache.org,34297,1676494900813 in 193 msec 2023-02-15 21:01:42,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, ASSIGN in 355 msec 2023-02-15 21:01:42,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, ASSIGN in 356 msec 2023-02-15 21:01:42,932 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,932 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,933 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1 2023-02-15 21:01:42,933 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1 2023-02-15 21:01:42,933 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1 2023-02-15 21:01:42,933 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1 2023-02-15 21:01:42,933 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91131e8ea09e93c79e45bbbfa440ceaf columnFamilyName f1 2023-02-15 21:01:42,933 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2e31c2d97427b77974af7210a896555 columnFamilyName f1 2023-02-15 21:01:42,934 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(310): Store=91131e8ea09e93c79e45bbbfa440ceaf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,934 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(310): Store=a2e31c2d97427b77974af7210a896555/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,934 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,934 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,935 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2 2023-02-15 21:01:42,935 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2 2023-02-15 21:01:42,935 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2 2023-02-15 21:01:42,935 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2 2023-02-15 21:01:42,935 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91131e8ea09e93c79e45bbbfa440ceaf columnFamilyName f2 2023-02-15 21:01:42,935 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2e31c2d97427b77974af7210a896555 columnFamilyName f2 2023-02-15 21:01:42,936 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(310): Store=91131e8ea09e93c79e45bbbfa440ceaf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,936 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(310): Store=a2e31c2d97427b77974af7210a896555/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:42,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:42,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 91131e8ea09e93c79e45bbbfa440ceaf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68740335, jitterRate=0.02431081235408783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:42,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a2e31c2d97427b77974af7210a896555; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74194579, jitterRate=0.10558538138866425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:42,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf., pid=25, masterSystemTime=1676494902887 2023-02-15 21:01:42,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555., pid=30, masterSystemTime=1676494902891 2023-02-15 21:01:42,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:42,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a28c2d004072829dbe8cd24902bb9bb4, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-15 21:01:42,947 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=91131e8ea09e93c79e45bbbfa440ceaf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,947 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902947"}]},"ts":"1676494902947"} 2023-02-15 21:01:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:42,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a2e31c2d97427b77974af7210a896555, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,948 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ae43ae4c6bae75378d1f4bf9e63ea1c3, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-15 21:01:42,949 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676494902089.a2e31c2d97427b77974af7210a896555.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902948"}]},"ts":"1676494902948"} 2023-02-15 21:01:42,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-15 21:01:42,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 91131e8ea09e93c79e45bbbfa440ceaf, server=jenkins-hbase4.apache.org,34297,1676494900813 in 211 msec 2023-02-15 21:01:42,950 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, ASSIGN in 377 msec 2023-02-15 21:01:42,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-15 21:01:42,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure a2e31c2d97427b77974af7210a896555, server=jenkins-hbase4.apache.org,33701,1676494900842 in 205 msec 2023-02-15 21:01:42,952 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1 2023-02-15 21:01:42,952 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1 2023-02-15 21:01:42,952 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae43ae4c6bae75378d1f4bf9e63ea1c3 columnFamilyName f1 2023-02-15 21:01:42,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, ASSIGN in 379 msec 2023-02-15 21:01:42,953 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(310): Store=ae43ae4c6bae75378d1f4bf9e63ea1c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,953 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,954 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2 2023-02-15 21:01:42,954 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2 2023-02-15 21:01:42,954 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae43ae4c6bae75378d1f4bf9e63ea1c3 columnFamilyName f2 2023-02-15 21:01:42,955 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(310): Store=ae43ae4c6bae75378d1f4bf9e63ea1c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,956 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1 2023-02-15 21:01:42,956 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1 2023-02-15 21:01:42,956 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a28c2d004072829dbe8cd24902bb9bb4 columnFamilyName f1 2023-02-15 21:01:42,957 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(310): Store=a28c2d004072829dbe8cd24902bb9bb4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,957 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,958 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2 2023-02-15 21:01:42,958 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2 2023-02-15 21:01:42,958 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a28c2d004072829dbe8cd24902bb9bb4 columnFamilyName f2 2023-02-15 21:01:42,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:42,959 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(310): Store=a28c2d004072829dbe8cd24902bb9bb4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ae43ae4c6bae75378d1f4bf9e63ea1c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61335800, jitterRate=-0.08602535724639893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:42,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3., pid=27, masterSystemTime=1676494902891 2023-02-15 21:01:42,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:42,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:42,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 21b986cefae2cd41bcd81324d06c5c2c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-15 21:01:42,964 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ae43ae4c6bae75378d1f4bf9e63ea1c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,964 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902964"}]},"ts":"1676494902964"} 2023-02-15 21:01:42,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,965 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a28c2d004072829dbe8cd24902bb9bb4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59942310, jitterRate=-0.1067899763584137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:42,967 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1 2023-02-15 21:01:42,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-15 21:01:42,967 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1 2023-02-15 21:01:42,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure ae43ae4c6bae75378d1f4bf9e63ea1c3, server=jenkins-hbase4.apache.org,33701,1676494900842 in 224 msec 2023-02-15 21:01:42,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4., pid=22, masterSystemTime=1676494902887 2023-02-15 21:01:42,968 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21b986cefae2cd41bcd81324d06c5c2c columnFamilyName f1 2023-02-15 21:01:42,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, ASSIGN in 394 msec 2023-02-15 21:01:42,969 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(310): Store=21b986cefae2cd41bcd81324d06c5c2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,969 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:42,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 970373a8437ef2b109dfc2507dd6a0d5, NAME => 'testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-15 21:01:42,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a28c2d004072829dbe8cd24902bb9bb4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902969"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902969"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902969"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902969"}]},"ts":"1676494902969"} 2023-02-15 21:01:42,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:42,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,970 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2 2023-02-15 21:01:42,970 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2 2023-02-15 21:01:42,970 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21b986cefae2cd41bcd81324d06c5c2c columnFamilyName f2 2023-02-15 21:01:42,971 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(310): Store=21b986cefae2cd41bcd81324d06c5c2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,971 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,972 DEBUG [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f1 2023-02-15 21:01:42,972 DEBUG [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f1 2023-02-15 21:01:42,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-15 21:01:42,973 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 970373a8437ef2b109dfc2507dd6a0d5 columnFamilyName f1 2023-02-15 21:01:42,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure a28c2d004072829dbe8cd24902bb9bb4, server=jenkins-hbase4.apache.org,34297,1676494900813 in 235 msec 2023-02-15 21:01:42,973 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(310): Store=970373a8437ef2b109dfc2507dd6a0d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,974 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, ASSIGN in 400 msec 2023-02-15 21:01:42,975 DEBUG [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f2 2023-02-15 21:01:42,975 DEBUG [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f2 2023-02-15 21:01:42,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,975 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 970373a8437ef2b109dfc2507dd6a0d5 columnFamilyName f2 2023-02-15 21:01:42,976 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(310): Store=970373a8437ef2b109dfc2507dd6a0d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:42,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:42,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 21b986cefae2cd41bcd81324d06c5c2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75162066, jitterRate=0.12000206112861633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:42,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:42,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c., pid=26, masterSystemTime=1676494902891 2023-02-15 21:01:42,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:42,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:42,981 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=21b986cefae2cd41bcd81324d06c5c2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:42,981 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494902981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902981"}]},"ts":"1676494902981"} 2023-02-15 21:01:42,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:42,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 970373a8437ef2b109dfc2507dd6a0d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68615625, jitterRate=0.02245248854160309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:42,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:42,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-15 21:01:42,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 21b986cefae2cd41bcd81324d06c5c2c, server=jenkins-hbase4.apache.org,33701,1676494900842 in 244 msec 2023-02-15 21:01:42,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5., pid=24, masterSystemTime=1676494902887 2023-02-15 21:01:42,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, ASSIGN in 411 msec 2023-02-15 21:01:42,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:42,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=970373a8437ef2b109dfc2507dd6a0d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:42,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494902986"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494902986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494902986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494902986"}]},"ts":"1676494902986"} 2023-02-15 21:01:42,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-15 21:01:42,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 970373a8437ef2b109dfc2507dd6a0d5, server=jenkins-hbase4.apache.org,34297,1676494900813 in 251 msec 2023-02-15 21:01:42,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 21:01:42,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, ASSIGN in 417 msec 2023-02-15 21:01:42,992 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:42,992 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494902992"}]},"ts":"1676494902992"} 2023-02-15 21:01:42,993 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-15 21:01:42,995 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:42,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 906 msec 2023-02-15 21:01:43,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:43,205 INFO [Listener at localhost/45445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-15 21:01:43,206 DEBUG [Listener at localhost/45445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-15 21:01:43,206 INFO [Listener at localhost/45445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:43,208 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-15 21:01:43,209 INFO [Listener at localhost/45445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:43,209 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-15 21:01:43,209 INFO [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:43,240 DEBUG [hconnection-0x5a4f50d1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:43,246 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37682, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:43,250 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34297] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:43,257 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33701] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:43,366 INFO [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:43,366 INFO [Listener at localhost/45445] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:43,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 21:01:43,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494903367 (current time:1676494903367). 2023-02-15 21:01:43,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:43,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] zookeeper.ReadOnlyZKClient(139): Connect 0x2755a242 to 127.0.0.1:51615 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:43,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e67e341, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:43,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:43,376 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57990, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2755a242 to 127.0.0.1:51615 2023-02-15 21:01:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:43,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:43,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 21:01:43,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 21:01:43,381 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 21:01:43,382 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676495503382 2023-02-15 21:01:43,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-15 21:01:43,382 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,385 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-15 21:01:43,385 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:43,385 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:43,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 21:01:43,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-15 21:01:43,387 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 21:01:43,387 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676495503387 2023-02-15 21:01:43,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,401 INFO [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 21:01:43,401 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:43,402 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 21:01:43,402 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 21:01:43,402 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,402 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,404 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:43,404 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:43,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:43,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:43,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:43,404 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:43,405 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,405 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,405 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,405 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:43,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,410 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 21:01:43,410 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-15 21:01:43,410 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:43,410 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:43,412 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 21:01:43,412 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 21:01:43,412 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 21:01:43,412 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 21:01:43,412 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34297,1676494900813' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 21:01:43,412 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33701,1676494900842' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 21:01:43,413 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,413 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,413 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,414 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:43,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:43,414 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,414 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,414 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:43,414 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:43,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:43,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33701,1676494900842' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ffd36f2[Count = 1] remaining members to acquire global barrier 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:43,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34297,1676494900813' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 21:01:43,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ffd36f2[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:43,418 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 21:01:43,418 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,419 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:43,419 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,419 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:43,419 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. started... 2023-02-15 21:01:43,419 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:43,419 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. started... 2023-02-15 21:01:43,420 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 146c7fea6672c9fa55fb9aa7aceef411 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:43,423 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 21:01:43,423 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:43,423 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:43,423 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-15 21:01:43,424 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:43,424 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:43,424 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. started... 2023-02-15 21:01:43,424 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:43,423 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,424 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:43,423 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:43,423 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:43,424 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. started... 2023-02-15 21:01:43,424 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,424 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a2e31c2d97427b77974af7210a896555 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:43,426 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d639c76fe0fc5e2bc0d3271609b340ae 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 21:01:43,424 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. started... 2023-02-15 21:01:43,426 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,426 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a28c2d004072829dbe8cd24902bb9bb4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:43,425 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. started... 2023-02-15 21:01:43,426 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:43,427 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 91131e8ea09e93c79e45bbbfa440ceaf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:43,427 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:43,458 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f1/582e32df9ff3426995a7cb18e149c1f1 2023-02-15 21:01:43,458 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. completed. 2023-02-15 21:01:43,458 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:43,458 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:43,458 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 21:01:43,458 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. started... 2023-02-15 21:01:43,465 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:43,465 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f1/7a6818568bd14cb2aaa069165c14b074 2023-02-15 21:01:43,465 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,465 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,465 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:43,465 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-15 21:01:43,470 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f1/fdb2434e31d747fa846f14687695b5ef 2023-02-15 21:01:43,480 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f1/bcfc0a9164534e07af0ce48c38519cc3 2023-02-15 21:01:43,485 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:43,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 21:01:43,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:43,488 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:43,504 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. completed. 2023-02-15 21:01:43,504 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:43,504 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:43,504 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 21:01:43,504 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f2/76da13f3b48741d4a15553d7faffb3a2 2023-02-15 21:01:43,504 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. started... 2023-02-15 21:01:43,504 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f2/d73225b6885a4d0cb0bba8769ec4794e 2023-02-15 21:01:43,506 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f2/a736c51a46354127ae1ce8cfed1c3d8c 2023-02-15 21:01:43,506 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 089cc74c3fe3bd73174bb55c58db69a7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:43,512 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f1/7a6818568bd14cb2aaa069165c14b074 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/7a6818568bd14cb2aaa069165c14b074 2023-02-15 21:01:43,512 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f1/582e32df9ff3426995a7cb18e149c1f1 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/582e32df9ff3426995a7cb18e149c1f1 2023-02-15 21:01:43,518 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/582e32df9ff3426995a7cb18e149c1f1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,518 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/7a6818568bd14cb2aaa069165c14b074, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,519 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f2/d73225b6885a4d0cb0bba8769ec4794e as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/d73225b6885a4d0cb0bba8769ec4794e 2023-02-15 21:01:43,519 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f1/fdb2434e31d747fa846f14687695b5ef as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/fdb2434e31d747fa846f14687695b5ef 2023-02-15 21:01:43,519 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f2/76da13f3b48741d4a15553d7faffb3a2 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/76da13f3b48741d4a15553d7faffb3a2 2023-02-15 21:01:43,522 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f2/94ab40bc3e59440ea62afbd82696ddd8 2023-02-15 21:01:43,526 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f1/bcfc0a9164534e07af0ce48c38519cc3 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/bcfc0a9164534e07af0ce48c38519cc3 2023-02-15 21:01:43,530 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/76da13f3b48741d4a15553d7faffb3a2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,530 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/d73225b6885a4d0cb0bba8769ec4794e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,530 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 146c7fea6672c9fa55fb9aa7aceef411 in 110ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,531 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-15 21:01:43,531 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/bcfc0a9164534e07af0ce48c38519cc3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,531 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/fdb2434e31d747fa846f14687695b5ef, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:43,531 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:43,531 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a2e31c2d97427b77974af7210a896555 in 107ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,531 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,532 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f2/94ab40bc3e59440ea62afbd82696ddd8 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/94ab40bc3e59440ea62afbd82696ddd8 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f2/a736c51a46354127ae1ce8cfed1c3d8c as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/a736c51a46354127ae1ce8cfed1c3d8c 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/7a6818568bd14cb2aaa069165c14b074] hfiles 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/7a6818568bd14cb2aaa069165c14b074 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/76da13f3b48741d4a15553d7faffb3a2] hfiles 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/76da13f3b48741d4a15553d7faffb3a2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,533 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/582e32df9ff3426995a7cb18e149c1f1] hfiles 2023-02-15 21:01:43,534 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/582e32df9ff3426995a7cb18e149c1f1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,534 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/d73225b6885a4d0cb0bba8769ec4794e] hfiles 2023-02-15 21:01:43,534 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/d73225b6885a4d0cb0bba8769ec4794e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,538 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/94ab40bc3e59440ea62afbd82696ddd8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,540 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 91131e8ea09e93c79e45bbbfa440ceaf in 113ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,540 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:43,540 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,540 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,540 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/bcfc0a9164534e07af0ce48c38519cc3] hfiles 2023-02-15 21:01:43,540 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/bcfc0a9164534e07af0ce48c38519cc3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,541 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/94ab40bc3e59440ea62afbd82696ddd8] hfiles 2023-02-15 21:01:43,541 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/94ab40bc3e59440ea62afbd82696ddd8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,553 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/a736c51a46354127ae1ce8cfed1c3d8c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:43,553 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f1/94b8015531d1465da54228ddee0af310 2023-02-15 21:01:43,554 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d639c76fe0fc5e2bc0d3271609b340ae in 129ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/fdb2434e31d747fa846f14687695b5ef] hfiles 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/fdb2434e31d747fa846f14687695b5ef for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/a736c51a46354127ae1ce8cfed1c3d8c] hfiles 2023-02-15 21:01:43,554 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/a736c51a46354127ae1ce8cfed1c3d8c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,555 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. completed. 2023-02-15 21:01:43,555 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:43,555 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:43,555 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. started... 2023-02-15 21:01:43,557 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ae43ae4c6bae75378d1f4bf9e63ea1c3 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-15 21:01:43,560 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-15 21:01:43,565 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. completed. 2023-02-15 21:01:43,565 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:43,565 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-15 21:01:43,565 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. started... 2023-02-15 21:01:43,566 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 21b986cefae2cd41bcd81324d06c5c2c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-15 21:01:43,568 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. completed. 2023-02-15 21:01:43,568 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 21:01:43,572 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f1/77c278f5e9354d54908a4d5685de6249 2023-02-15 21:01:43,582 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. completed. 2023-02-15 21:01:43,582 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-15 21:01:43,597 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f2/d276d3858eb348929ffdb2eb1639c01e 2023-02-15 21:01:43,609 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f1/15603d517e87473ab1210e0bafe7dafe 2023-02-15 21:01:43,612 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f1/94b8015531d1465da54228ddee0af310 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/94b8015531d1465da54228ddee0af310 2023-02-15 21:01:43,620 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/94b8015531d1465da54228ddee0af310, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,621 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f2/d276d3858eb348929ffdb2eb1639c01e as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/d276d3858eb348929ffdb2eb1639c01e 2023-02-15 21:01:43,630 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/d276d3858eb348929ffdb2eb1639c01e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,631 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 089cc74c3fe3bd73174bb55c58db69a7 in 125ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/94b8015531d1465da54228ddee0af310] hfiles 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/94b8015531d1465da54228ddee0af310 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/d276d3858eb348929ffdb2eb1639c01e] hfiles 2023-02-15 21:01:43,631 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/d276d3858eb348929ffdb2eb1639c01e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,636 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f2/d3c70c69eabe408cb32130fa4247a058 2023-02-15 21:01:43,647 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f1/15603d517e87473ab1210e0bafe7dafe as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/15603d517e87473ab1210e0bafe7dafe 2023-02-15 21:01:43,648 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. completed. 2023-02-15 21:01:43,649 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:43,649 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 21:01:43,652 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/15603d517e87473ab1210e0bafe7dafe, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,653 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f2/d3c70c69eabe408cb32130fa4247a058 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/d3c70c69eabe408cb32130fa4247a058 2023-02-15 21:01:43,659 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/d3c70c69eabe408cb32130fa4247a058, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,659 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 21b986cefae2cd41bcd81324d06c5c2c in 93ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/15603d517e87473ab1210e0bafe7dafe] hfiles 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/15603d517e87473ab1210e0bafe7dafe for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/d3c70c69eabe408cb32130fa4247a058] hfiles 2023-02-15 21:01:43,660 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/d3c70c69eabe408cb32130fa4247a058 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,670 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. completed. 2023-02-15 21:01:43,670 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:43,670 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-15 21:01:43,688 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:43,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 21:01:43,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:43,690 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-15 21:01:43,866 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f1/6387038f4d9a4da5b021cacbde118434 2023-02-15 21:01:43,879 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f2/46ed49295b9c4d028cb0b14068caa4d5 2023-02-15 21:01:43,884 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f1/6387038f4d9a4da5b021cacbde118434 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/6387038f4d9a4da5b021cacbde118434 2023-02-15 21:01:43,888 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/6387038f4d9a4da5b021cacbde118434, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,888 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f2/46ed49295b9c4d028cb0b14068caa4d5 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/46ed49295b9c4d028cb0b14068caa4d5 2023-02-15 21:01:43,892 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/46ed49295b9c4d028cb0b14068caa4d5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-15 21:01:43,893 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a28c2d004072829dbe8cd24902bb9bb4 in 467ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/6387038f4d9a4da5b021cacbde118434] hfiles 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/6387038f4d9a4da5b021cacbde118434 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/46ed49295b9c4d028cb0b14068caa4d5] hfiles 2023-02-15 21:01:43,893 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/46ed49295b9c4d028cb0b14068caa4d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,898 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. completed. 2023-02-15 21:01:43,898 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:43,898 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 21:01:43,898 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 21:01:43,898 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 21:01:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34297,1676494900813' in zk 2023-02-15 21:01:43,900 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,900 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 21:01:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:43,900 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:43,900 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 21:01:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34297,1676494900813': 2023-02-15 21:01:43,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34297,1676494900813' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 21:01:43,990 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:43,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 21:01:43,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:43,991 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-15 21:01:44,020 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f2/535f45de58f44725a4bfeb72852ebe98 2023-02-15 21:01:44,025 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f1/77c278f5e9354d54908a4d5685de6249 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/77c278f5e9354d54908a4d5685de6249 2023-02-15 21:01:44,028 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/77c278f5e9354d54908a4d5685de6249, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:44,029 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f2/535f45de58f44725a4bfeb72852ebe98 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/535f45de58f44725a4bfeb72852ebe98 2023-02-15 21:01:44,033 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/535f45de58f44725a4bfeb72852ebe98, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-15 21:01:44,034 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ae43ae4c6bae75378d1f4bf9e63ea1c3 in 477ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/77c278f5e9354d54908a4d5685de6249] hfiles 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/77c278f5e9354d54908a4d5685de6249 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/535f45de58f44725a4bfeb72852ebe98] hfiles 2023-02-15 21:01:44,034 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/535f45de58f44725a4bfeb72852ebe98 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,044 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. completed. 2023-02-15 21:01:44,044 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:44,044 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-15 21:01:44,044 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-15 21:01:44,044 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,044 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 21:01:44,044 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33701,1676494900842' in zk 2023-02-15 21:01:44,049 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 21:01:44,049 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,049 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:44,049 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 21:01:44,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33701,1676494900842': 2023-02-15 21:01:44,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33701,1676494900842' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:44,052 INFO [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 21:01:44,052 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:44,052 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:44,053 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,053 INFO [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:44,054 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:44,054 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:44,054 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,054 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:44,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:44,055 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:44,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,055 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,056 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,057 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,061 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,061 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:44,061 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:44,061 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:44,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:44,062 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:44,062 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:44,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-15 21:01:44,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,122 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676494903382Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676494904062 (+680 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676494904062Writing data manifest for testWithMockedMapReduceMultiRegion at 1676494904070 (+8 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676494904084 (+14 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676494904122 (+38 ms) 2023-02-15 21:01:44,124 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-15 21:01:44,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 740 msec 2023-02-15 21:01:44,491 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:44,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-15 21:01:44,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:44,493 INFO [Listener at localhost/45445] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:44,497 INFO [Listener at localhost/45445] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:44,502 INFO [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:44,523 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34297] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:44,534 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33701] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:44,588 INFO [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:44,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:44,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,596 INFO [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-15 21:01:44,596 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:44,597 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-15 21:01:44,597 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-15 21:01:44,598 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,598 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,600 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:44,600 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:44,600 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,601 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,601 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,601 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,601 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,602 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,602 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,602 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 21:01:44,602 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:44,602 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-15 21:01:44,603 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 21:01:44,603 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:44,603 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-15 21:01:44,603 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. started... 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. started... 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:44,604 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 146c7fea6672c9fa55fb9aa7aceef411 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. started... 2023-02-15 21:01:44,604 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a2e31c2d97427b77974af7210a896555 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 21:01:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. started... 2023-02-15 21:01:44,604 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d639c76fe0fc5e2bc0d3271609b340ae 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 21:01:44,608 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:44,610 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. started... 2023-02-15 21:01:44,610 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:44,610 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91131e8ea09e93c79e45bbbfa440ceaf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:44,610 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:44,610 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. started... 2023-02-15 21:01:44,608 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-15 21:01:44,610 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a28c2d004072829dbe8cd24902bb9bb4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:44,610 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:44,610 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. started... 2023-02-15 21:01:44,611 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:44,611 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:44,610 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 21:01:44,611 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:44,611 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 21:01:44,611 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. started... 2023-02-15 21:01:44,611 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 089cc74c3fe3bd73174bb55c58db69a7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:44,654 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f1/15575efedb264cd0a73e275c006ae126 2023-02-15 21:01:44,655 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f1/b5770cc15f8144fbabde2f0880bd093b 2023-02-15 21:01:44,656 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f1/2a0bb7dfc070433c9072c404d7159738 2023-02-15 21:01:44,670 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f1/359794e8596b462fba9aef5f28a1cb9c 2023-02-15 21:01:44,677 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f1/4abc828df1fc4e7a8159af7824435c67 2023-02-15 21:01:44,692 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f1/ff6056172ee0462994d922261afddba4 2023-02-15 21:01:44,708 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f2/8649724a41ee4dfda95b7a3527618a7c 2023-02-15 21:01:44,713 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f1/15575efedb264cd0a73e275c006ae126 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/15575efedb264cd0a73e275c006ae126 2023-02-15 21:01:44,717 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f2/f6e3b0cc513446d8af77ad458c1662b5 2023-02-15 21:01:44,718 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/15575efedb264cd0a73e275c006ae126, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,719 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/.tmp/f2/8649724a41ee4dfda95b7a3527618a7c as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/8649724a41ee4dfda95b7a3527618a7c 2023-02-15 21:01:44,722 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f1/b5770cc15f8144fbabde2f0880bd093b as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/b5770cc15f8144fbabde2f0880bd093b 2023-02-15 21:01:44,723 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/8649724a41ee4dfda95b7a3527618a7c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,724 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 146c7fea6672c9fa55fb9aa7aceef411 in 120ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,724 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:44,724 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:44,726 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/b5770cc15f8144fbabde2f0880bd093b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:44,727 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/.tmp/f2/f6e3b0cc513446d8af77ad458c1662b5 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/f6e3b0cc513446d8af77ad458c1662b5 2023-02-15 21:01:44,728 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:44,728 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. started... 2023-02-15 21:01:44,728 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-15 21:01:44,728 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ae43ae4c6bae75378d1f4bf9e63ea1c3 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-15 21:01:44,731 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/f6e3b0cc513446d8af77ad458c1662b5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:44,732 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d639c76fe0fc5e2bc0d3271609b340ae in 128ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,732 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:44,732 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:44,732 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-15 21:01:44,732 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. started... 2023-02-15 21:01:44,732 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21b986cefae2cd41bcd81324d06c5c2c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-15 21:01:44,732 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f2/87d766c348fa4d24aea3188bc60130c8 2023-02-15 21:01:44,740 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f1/359794e8596b462fba9aef5f28a1cb9c as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/359794e8596b462fba9aef5f28a1cb9c 2023-02-15 21:01:44,740 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f2/be02406cf9a94d9e8d9c0b672e4bd786 2023-02-15 21:01:44,746 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f1/ff6056172ee0462994d922261afddba4 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/ff6056172ee0462994d922261afddba4 2023-02-15 21:01:44,748 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f2/e3311a4af76549e7ae3c0fe0b0b64364 2023-02-15 21:01:44,748 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f2/51a9eaf316894db48cb8374bb0965c7d 2023-02-15 21:01:44,752 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/359794e8596b462fba9aef5f28a1cb9c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,752 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/ff6056172ee0462994d922261afddba4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,752 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/.tmp/f2/87d766c348fa4d24aea3188bc60130c8 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/87d766c348fa4d24aea3188bc60130c8 2023-02-15 21:01:44,753 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/.tmp/f2/be02406cf9a94d9e8d9c0b672e4bd786 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/be02406cf9a94d9e8d9c0b672e4bd786 2023-02-15 21:01:44,754 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f1/4abc828df1fc4e7a8159af7824435c67 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/4abc828df1fc4e7a8159af7824435c67 2023-02-15 21:01:44,758 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f1/2a0bb7dfc070433c9072c404d7159738 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/2a0bb7dfc070433c9072c404d7159738 2023-02-15 21:01:44,761 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/87d766c348fa4d24aea3188bc60130c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,762 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 089cc74c3fe3bd73174bb55c58db69a7 in 151ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,762 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:44,762 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:44,763 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 21:01:44,763 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/2a0bb7dfc070433c9072c404d7159738, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,764 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/.tmp/f2/51a9eaf316894db48cb8374bb0965c7d as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/51a9eaf316894db48cb8374bb0965c7d 2023-02-15 21:01:44,765 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f1/52e318f41a1940dcaedea2260d43e099 2023-02-15 21:01:44,765 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/4abc828df1fc4e7a8159af7824435c67, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,765 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/be02406cf9a94d9e8d9c0b672e4bd786, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,766 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 91131e8ea09e93c79e45bbbfa440ceaf in 156ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,766 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:44,766 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 21:01:44,767 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/.tmp/f2/e3311a4af76549e7ae3c0fe0b0b64364 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/e3311a4af76549e7ae3c0fe0b0b64364 2023-02-15 21:01:44,768 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f1/b06882ef03c54c7bae24a0217d1cd36c 2023-02-15 21:01:44,778 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/e3311a4af76549e7ae3c0fe0b0b64364, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,778 INFO [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a28c2d004072829dbe8cd24902bb9bb4 in 168ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,778 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:44,779 DEBUG [rs(jenkins-hbase4.apache.org,34297,1676494900813)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:44,779 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 21:01:44,779 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 21:01:44,779 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 21:01:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34297,1676494900813' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 21:01:44,781 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/51a9eaf316894db48cb8374bb0965c7d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,782 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a2e31c2d97427b77974af7210a896555 in 178ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,782 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:44,782 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:44,782 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-15 21:01:44,782 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,782 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:44,783 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,783 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34297,1676494900813' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 21:01:44,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc2b7d5[Count = 1] remaining members to acquire global barrier 2023-02-15 21:01:44,803 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f2/4516483171744aec89cd1897f172993a 2023-02-15 21:01:44,806 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f2/ea0b9ddde75f46d6bea34399e619a99b 2023-02-15 21:01:44,808 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f1/52e318f41a1940dcaedea2260d43e099 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/52e318f41a1940dcaedea2260d43e099 2023-02-15 21:01:44,816 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f1/b06882ef03c54c7bae24a0217d1cd36c as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/b06882ef03c54c7bae24a0217d1cd36c 2023-02-15 21:01:44,817 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/52e318f41a1940dcaedea2260d43e099, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,818 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/.tmp/f2/4516483171744aec89cd1897f172993a as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/4516483171744aec89cd1897f172993a 2023-02-15 21:01:44,821 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/b06882ef03c54c7bae24a0217d1cd36c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:44,822 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/.tmp/f2/ea0b9ddde75f46d6bea34399e619a99b as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/ea0b9ddde75f46d6bea34399e619a99b 2023-02-15 21:01:44,822 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/4516483171744aec89cd1897f172993a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-15 21:01:44,823 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 21b986cefae2cd41bcd81324d06c5c2c in 91ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,823 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:44,823 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:44,823 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-15 21:01:44,826 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/ea0b9ddde75f46d6bea34399e619a99b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-15 21:01:44,827 INFO [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ae43ae4c6bae75378d1f4bf9e63ea1c3 in 99ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:44,827 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:44,827 DEBUG [rs(jenkins-hbase4.apache.org,33701,1676494900842)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:44,827 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-15 21:01:44,827 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-15 21:01:44,827 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-15 21:01:44,828 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33701,1676494900842' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-15 21:01:44,829 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,829 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:44,829 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,829 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33701,1676494900842' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-15 21:01:44,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc2b7d5[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:44,832 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-15 21:01:44,832 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-15 21:01:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 21:01:44,833 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34297,1676494900813' in zk 2023-02-15 21:01:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-15 21:01:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33701,1676494900842' in zk 2023-02-15 21:01:44,834 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,834 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:44,838 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,838 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 21:01:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,838 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:44,838 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,839 DEBUG [member: 'jenkins-hbase4.apache.org,34297,1676494900813' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 21:01:44,838 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-15 21:01:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:44,839 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:44,839 DEBUG [member: 'jenkins-hbase4.apache.org,33701,1676494900842' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-15 21:01:44,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34297,1676494900813': 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34297,1676494900813' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:44,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33701,1676494900842': 2023-02-15 21:01:44,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33701,1676494900842' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:44,844 INFO [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-15 21:01:44,844 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:44,844 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:44,844 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,844 INFO [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:44,845 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,845 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,845 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:44,846 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:44,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,845 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,846 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:44,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:44,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:44,846 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,848 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,848 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:44,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,850 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,850 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,850 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:44,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:44,850 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:44,851 DEBUG [(jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:44,850 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:44,850 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:44,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-15 21:01:44,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:44,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:44,851 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:01:44,952 DEBUG [Listener at localhost/45445] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:01:44,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:01:44,959 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676494903367 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:44,959 DEBUG [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(239): region to add: ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=163fcfc537af2d5a53badc6fadb408ee as 163fcfc537af2d5a53badc6fadb408ee in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=146c7fea6672c9fa55fb9aa7aceef411 as 146c7fea6672c9fa55fb9aa7aceef411 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=a2e31c2d97427b77974af7210a896555 as a2e31c2d97427b77974af7210a896555 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=91131e8ea09e93c79e45bbbfa440ceaf as 91131e8ea09e93c79e45bbbfa440ceaf in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=a28c2d004072829dbe8cd24902bb9bb4 as a28c2d004072829dbe8cd24902bb9bb4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=970373a8437ef2b109dfc2507dd6a0d5 as 970373a8437ef2b109dfc2507dd6a0d5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,960 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=d639c76fe0fc5e2bc0d3271609b340ae as d639c76fe0fc5e2bc0d3271609b340ae in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,961 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=089cc74c3fe3bd73174bb55c58db69a7 as 089cc74c3fe3bd73174bb55c58db69a7 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,961 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=21b986cefae2cd41bcd81324d06c5c2c as 21b986cefae2cd41bcd81324d06c5c2c in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,961 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(585): clone region=ae43ae4c6bae75378d1f4bf9e63ea1c3 as ae43ae4c6bae75378d1f4bf9e63ea1c3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,962 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d639c76fe0fc5e2bc0d3271609b340ae, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,963 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 163fcfc537af2d5a53badc6fadb408ee, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,963 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 970373a8437ef2b109dfc2507dd6a0d5, NAME => 'testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,963 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 91131e8ea09e93c79e45bbbfa440ceaf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,963 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => a2e31c2d97427b77974af7210a896555, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,964 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 146c7fea6672c9fa55fb9aa7aceef411, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,964 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 089cc74c3fe3bd73174bb55c58db69a7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,964 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => a28c2d004072829dbe8cd24902bb9bb4, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:44,996 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:44,996 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:44,996 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94b8015531d1465da54228ddee0af310 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:44,996 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7a6818568bd14cb2aaa069165c14b074 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,008 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,008 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 163fcfc537af2d5a53badc6fadb408ee, disabling compactions & flushes 2023-02-15 21:01:45,008 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,008 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,008 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. after waiting 0 ms 2023-02-15 21:01:45,009 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,009 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d276d3858eb348929ffdb2eb1639c01e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,009 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,009 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:45,009 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 21b986cefae2cd41bcd81324d06c5c2c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:45,012 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,012 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bcfc0a9164534e07af0ce48c38519cc3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,016 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 76da13f3b48741d4a15553d7faffb3a2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,024 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 089cc74c3fe3bd73174bb55c58db69a7, disabling compactions & flushes 2023-02-15 21:01:45,024 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,024 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,024 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. after waiting 0 ms 2023-02-15 21:01:45,024 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,024 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,024 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:45,025 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ae43ae4c6bae75378d1f4bf9e63ea1c3, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:45,028 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94ab40bc3e59440ea62afbd82696ddd8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,034 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 146c7fea6672c9fa55fb9aa7aceef411, disabling compactions & flushes 2023-02-15 21:01:45,034 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,034 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,034 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. after waiting 0 ms 2023-02-15 21:01:45,034 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,034 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,034 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:45,036 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,036 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 91131e8ea09e93c79e45bbbfa440ceaf, disabling compactions & flushes 2023-02-15 21:01:45,036 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,036 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,036 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. after waiting 0 ms 2023-02-15 21:01:45,036 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 582e32df9ff3426995a7cb18e149c1f1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,036 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,036 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,036 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:45,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 970373a8437ef2b109dfc2507dd6a0d5, disabling compactions & flushes 2023-02-15 21:01:45,037 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. after waiting 0 ms 2023-02-15 21:01:45,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,037 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:45,042 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,042 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fdb2434e31d747fa846f14687695b5ef from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,043 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,043 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6387038f4d9a4da5b021cacbde118434 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,045 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d73225b6885a4d0cb0bba8769ec4794e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,050 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a736c51a46354127ae1ce8cfed1c3d8c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,052 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d639c76fe0fc5e2bc0d3271609b340ae, disabling compactions & flushes 2023-02-15 21:01:45,052 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,052 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,052 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 77c278f5e9354d54908a4d5685de6249 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,052 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,052 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. after waiting 0 ms 2023-02-15 21:01:45,052 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,052 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,052 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:45,054 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing a2e31c2d97427b77974af7210a896555, disabling compactions & flushes 2023-02-15 21:01:45,054 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,054 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,054 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. after waiting 0 ms 2023-02-15 21:01:45,054 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,054 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,054 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:45,054 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46ed49295b9c4d028cb0b14068caa4d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,054 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 535f45de58f44725a4bfeb72852ebe98 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,054 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,054 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 15603d517e87473ab1210e0bafe7dafe from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,056 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing a28c2d004072829dbe8cd24902bb9bb4, disabling compactions & flushes 2023-02-15 21:01:45,056 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. after waiting 0 ms 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,057 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:45,057 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d3c70c69eabe408cb32130fa4247a058 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ae43ae4c6bae75378d1f4bf9e63ea1c3, disabling compactions & flushes 2023-02-15 21:01:45,057 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. after waiting 0 ms 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,057 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,057 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:45,058 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 21b986cefae2cd41bcd81324d06c5c2c, disabling compactions & flushes 2023-02-15 21:01:45,058 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,059 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,059 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. after waiting 0 ms 2023-02-15 21:01:45,059 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,059 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,059 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:45,059 INFO [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676494903367 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:45,059 DEBUG [Listener at localhost/45445] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:45,059 DEBUG [Listener at localhost/45445] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8 2023-02-15 21:01:45,060 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-data/ 2023-02-15 21:01:45,060 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----default/ 2023-02-15 21:01:45,060 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-15 21:01:45,061 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------089cc74c3fe3bd73174bb55c58db69a7/ 2023-02-15 21:01:45,061 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,061 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,062 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=089cc74c3fe3bd73174bb55c58db69a7-94b8015531d1465da54228ddee0af310 2023-02-15 21:01:45,062 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,062 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=089cc74c3fe3bd73174bb55c58db69a7-d276d3858eb348929ffdb2eb1639c01e 2023-02-15 21:01:45,062 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------146c7fea6672c9fa55fb9aa7aceef411/ 2023-02-15 21:01:45,062 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,062 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,063 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=146c7fea6672c9fa55fb9aa7aceef411-7a6818568bd14cb2aaa069165c14b074 2023-02-15 21:01:45,063 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,063 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=146c7fea6672c9fa55fb9aa7aceef411-76da13f3b48741d4a15553d7faffb3a2 2023-02-15 21:01:45,063 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------163fcfc537af2d5a53badc6fadb408ee/ 2023-02-15 21:01:45,063 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,063 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------21b986cefae2cd41bcd81324d06c5c2c/ 2023-02-15 21:01:45,064 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,064 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,064 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=21b986cefae2cd41bcd81324d06c5c2c-15603d517e87473ab1210e0bafe7dafe 2023-02-15 21:01:45,064 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,064 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=21b986cefae2cd41bcd81324d06c5c2c-d3c70c69eabe408cb32130fa4247a058 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------91131e8ea09e93c79e45bbbfa440ceaf/ 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=91131e8ea09e93c79e45bbbfa440ceaf-bcfc0a9164534e07af0ce48c38519cc3 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=91131e8ea09e93c79e45bbbfa440ceaf-94ab40bc3e59440ea62afbd82696ddd8 2023-02-15 21:01:45,065 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------970373a8437ef2b109dfc2507dd6a0d5/ 2023-02-15 21:01:45,066 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,066 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------a28c2d004072829dbe8cd24902bb9bb4/ 2023-02-15 21:01:45,066 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,066 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,066 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a28c2d004072829dbe8cd24902bb9bb4-6387038f4d9a4da5b021cacbde118434 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a28c2d004072829dbe8cd24902bb9bb4-46ed49295b9c4d028cb0b14068caa4d5 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------a2e31c2d97427b77974af7210a896555/ 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a2e31c2d97427b77974af7210a896555-582e32df9ff3426995a7cb18e149c1f1 2023-02-15 21:01:45,067 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,068 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=a2e31c2d97427b77974af7210a896555-d73225b6885a4d0cb0bba8769ec4794e 2023-02-15 21:01:45,068 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------ae43ae4c6bae75378d1f4bf9e63ea1c3/ 2023-02-15 21:01:45,068 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,068 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,068 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ae43ae4c6bae75378d1f4bf9e63ea1c3-77c278f5e9354d54908a4d5685de6249 2023-02-15 21:01:45,069 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,069 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=ae43ae4c6bae75378d1f4bf9e63ea1c3-535f45de58f44725a4bfeb72852ebe98 2023-02-15 21:01:45,069 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |----------d639c76fe0fc5e2bc0d3271609b340ae/ 2023-02-15 21:01:45,069 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:45,069 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:45,069 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d639c76fe0fc5e2bc0d3271609b340ae-fdb2434e31d747fa846f14687695b5ef 2023-02-15 21:01:45,070 DEBUG [Listener at localhost/45445] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:45,070 DEBUG [Listener at localhost/45445] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d639c76fe0fc5e2bc0d3271609b340ae-a736c51a46354127ae1ce8cfed1c3d8c 2023-02-15 21:01:45,073 INFO [Listener at localhost/45445] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 21:01:45,632 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,632 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,634 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,636 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:45,637 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1 2023-02-15 21:01:45,637 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21b986cefae2cd41bcd81324d06c5c2c columnFamilyName f1 2023-02-15 21:01:45,641 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/testWithMockedMapReduceMultiRegion=21b986cefae2cd41bcd81324d06c5c2c-15603d517e87473ab1210e0bafe7dafe 2023-02-15 21:01:45,641 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(310): Store=21b986cefae2cd41bcd81324d06c5c2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,641 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:45,642 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2 2023-02-15 21:01:45,642 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21b986cefae2cd41bcd81324d06c5c2c columnFamilyName f2 2023-02-15 21:01:45,646 DEBUG [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/testWithMockedMapReduceMultiRegion=21b986cefae2cd41bcd81324d06c5c2c-d3c70c69eabe408cb32130fa4247a058 2023-02-15 21:01:45,646 INFO [StoreOpener-21b986cefae2cd41bcd81324d06c5c2c-1] regionserver.HStore(310): Store=21b986cefae2cd41bcd81324d06c5c2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,646 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,647 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened 21b986cefae2cd41bcd81324d06c5c2c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72521506, jitterRate=0.08065465092658997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,647 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:45,656 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing 21b986cefae2cd41bcd81324d06c5c2c, disabling compactions & flushes 2023-02-15 21:01:45,657 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,657 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,657 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. after waiting 0 ms 2023-02-15 21:01:45,657 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,658 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:45,658 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:45,659 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,659 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,661 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,663 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:45,664 DEBUG [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f1 2023-02-15 21:01:45,664 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 163fcfc537af2d5a53badc6fadb408ee columnFamilyName f1 2023-02-15 21:01:45,665 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(310): Store=163fcfc537af2d5a53badc6fadb408ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,665 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:45,666 DEBUG [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f2 2023-02-15 21:01:45,666 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 163fcfc537af2d5a53badc6fadb408ee columnFamilyName f2 2023-02-15 21:01:45,666 INFO [StoreOpener-163fcfc537af2d5a53badc6fadb408ee-1] regionserver.HStore(310): Store=163fcfc537af2d5a53badc6fadb408ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,667 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,667 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened 163fcfc537af2d5a53badc6fadb408ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64566532, jitterRate=-0.0378836989402771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,667 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:45,667 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing 163fcfc537af2d5a53badc6fadb408ee, disabling compactions & flushes 2023-02-15 21:01:45,667 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,667 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,667 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. after waiting 0 ms 2023-02-15 21:01:45,667 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,668 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:45,668 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:45,668 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,668 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,669 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,671 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:45,672 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1 2023-02-15 21:01:45,672 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 089cc74c3fe3bd73174bb55c58db69a7 columnFamilyName f1 2023-02-15 21:01:45,675 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/testWithMockedMapReduceMultiRegion=089cc74c3fe3bd73174bb55c58db69a7-94b8015531d1465da54228ddee0af310 2023-02-15 21:01:45,676 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(310): Store=089cc74c3fe3bd73174bb55c58db69a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,676 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:45,676 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2 2023-02-15 21:01:45,677 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 089cc74c3fe3bd73174bb55c58db69a7 columnFamilyName f2 2023-02-15 21:01:45,680 DEBUG [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/testWithMockedMapReduceMultiRegion=089cc74c3fe3bd73174bb55c58db69a7-d276d3858eb348929ffdb2eb1639c01e 2023-02-15 21:01:45,680 INFO [StoreOpener-089cc74c3fe3bd73174bb55c58db69a7-1] regionserver.HStore(310): Store=089cc74c3fe3bd73174bb55c58db69a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,680 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,680 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened 089cc74c3fe3bd73174bb55c58db69a7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67597897, jitterRate=0.007287159562110901}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,680 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:45,689 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing 089cc74c3fe3bd73174bb55c58db69a7, disabling compactions & flushes 2023-02-15 21:01:45,689 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,689 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,689 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. after waiting 0 ms 2023-02-15 21:01:45,689 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,690 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:45,690 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:45,691 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,691 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,692 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,694 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:45,695 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1 2023-02-15 21:01:45,695 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91131e8ea09e93c79e45bbbfa440ceaf columnFamilyName f1 2023-02-15 21:01:45,698 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/testWithMockedMapReduceMultiRegion=91131e8ea09e93c79e45bbbfa440ceaf-bcfc0a9164534e07af0ce48c38519cc3 2023-02-15 21:01:45,698 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(310): Store=91131e8ea09e93c79e45bbbfa440ceaf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,699 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:45,699 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2 2023-02-15 21:01:45,699 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91131e8ea09e93c79e45bbbfa440ceaf columnFamilyName f2 2023-02-15 21:01:45,703 DEBUG [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/testWithMockedMapReduceMultiRegion=91131e8ea09e93c79e45bbbfa440ceaf-94ab40bc3e59440ea62afbd82696ddd8 2023-02-15 21:01:45,703 INFO [StoreOpener-91131e8ea09e93c79e45bbbfa440ceaf-1] regionserver.HStore(310): Store=91131e8ea09e93c79e45bbbfa440ceaf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,703 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,703 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened 91131e8ea09e93c79e45bbbfa440ceaf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72247758, jitterRate=0.07657548785209656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,704 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:45,712 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing 91131e8ea09e93c79e45bbbfa440ceaf, disabling compactions & flushes 2023-02-15 21:01:45,712 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,712 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,712 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. after waiting 0 ms 2023-02-15 21:01:45,712 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,713 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:45,713 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:45,714 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,714 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,715 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,717 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:45,718 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1 2023-02-15 21:01:45,718 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 146c7fea6672c9fa55fb9aa7aceef411 columnFamilyName f1 2023-02-15 21:01:45,723 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/testWithMockedMapReduceMultiRegion=146c7fea6672c9fa55fb9aa7aceef411-7a6818568bd14cb2aaa069165c14b074 2023-02-15 21:01:45,723 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(310): Store=146c7fea6672c9fa55fb9aa7aceef411/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,723 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:45,724 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2 2023-02-15 21:01:45,724 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 146c7fea6672c9fa55fb9aa7aceef411 columnFamilyName f2 2023-02-15 21:01:45,728 DEBUG [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/testWithMockedMapReduceMultiRegion=146c7fea6672c9fa55fb9aa7aceef411-76da13f3b48741d4a15553d7faffb3a2 2023-02-15 21:01:45,728 INFO [StoreOpener-146c7fea6672c9fa55fb9aa7aceef411-1] regionserver.HStore(310): Store=146c7fea6672c9fa55fb9aa7aceef411/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,729 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,729 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened 146c7fea6672c9fa55fb9aa7aceef411; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69998099, jitterRate=0.04305295646190643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,729 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:45,737 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing 146c7fea6672c9fa55fb9aa7aceef411, disabling compactions & flushes 2023-02-15 21:01:45,737 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,737 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,737 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. after waiting 0 ms 2023-02-15 21:01:45,738 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,738 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:45,738 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:45,739 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,739 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,740 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,742 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:45,743 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1 2023-02-15 21:01:45,743 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae43ae4c6bae75378d1f4bf9e63ea1c3 columnFamilyName f1 2023-02-15 21:01:45,747 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/testWithMockedMapReduceMultiRegion=ae43ae4c6bae75378d1f4bf9e63ea1c3-77c278f5e9354d54908a4d5685de6249 2023-02-15 21:01:45,747 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(310): Store=ae43ae4c6bae75378d1f4bf9e63ea1c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,747 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:45,748 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2 2023-02-15 21:01:45,748 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae43ae4c6bae75378d1f4bf9e63ea1c3 columnFamilyName f2 2023-02-15 21:01:45,752 DEBUG [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/testWithMockedMapReduceMultiRegion=ae43ae4c6bae75378d1f4bf9e63ea1c3-535f45de58f44725a4bfeb72852ebe98 2023-02-15 21:01:45,752 INFO [StoreOpener-ae43ae4c6bae75378d1f4bf9e63ea1c3-1] regionserver.HStore(310): Store=ae43ae4c6bae75378d1f4bf9e63ea1c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,752 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,752 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened ae43ae4c6bae75378d1f4bf9e63ea1c3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75495154, jitterRate=0.12496545910835266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,753 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:45,768 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing ae43ae4c6bae75378d1f4bf9e63ea1c3, disabling compactions & flushes 2023-02-15 21:01:45,768 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,768 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,768 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. after waiting 0 ms 2023-02-15 21:01:45,768 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,769 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:45,769 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:45,770 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,770 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,771 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,773 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:45,774 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1 2023-02-15 21:01:45,774 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2e31c2d97427b77974af7210a896555 columnFamilyName f1 2023-02-15 21:01:45,778 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/testWithMockedMapReduceMultiRegion=a2e31c2d97427b77974af7210a896555-582e32df9ff3426995a7cb18e149c1f1 2023-02-15 21:01:45,778 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(310): Store=a2e31c2d97427b77974af7210a896555/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,778 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:45,779 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2 2023-02-15 21:01:45,779 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2e31c2d97427b77974af7210a896555 columnFamilyName f2 2023-02-15 21:01:45,782 DEBUG [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/testWithMockedMapReduceMultiRegion=a2e31c2d97427b77974af7210a896555-d73225b6885a4d0cb0bba8769ec4794e 2023-02-15 21:01:45,783 INFO [StoreOpener-a2e31c2d97427b77974af7210a896555-1] regionserver.HStore(310): Store=a2e31c2d97427b77974af7210a896555/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,783 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,783 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened a2e31c2d97427b77974af7210a896555; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75455173, jitterRate=0.12436969578266144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,783 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:45,791 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing a2e31c2d97427b77974af7210a896555, disabling compactions & flushes 2023-02-15 21:01:45,791 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,791 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,791 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. after waiting 0 ms 2023-02-15 21:01:45,791 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,792 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:45,792 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:45,792 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,793 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,795 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,797 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:45,798 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1 2023-02-15 21:01:45,798 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d639c76fe0fc5e2bc0d3271609b340ae columnFamilyName f1 2023-02-15 21:01:45,802 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/testWithMockedMapReduceMultiRegion=d639c76fe0fc5e2bc0d3271609b340ae-fdb2434e31d747fa846f14687695b5ef 2023-02-15 21:01:45,802 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(310): Store=d639c76fe0fc5e2bc0d3271609b340ae/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,802 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:45,803 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2 2023-02-15 21:01:45,803 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d639c76fe0fc5e2bc0d3271609b340ae columnFamilyName f2 2023-02-15 21:01:45,806 DEBUG [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/testWithMockedMapReduceMultiRegion=d639c76fe0fc5e2bc0d3271609b340ae-a736c51a46354127ae1ce8cfed1c3d8c 2023-02-15 21:01:45,806 INFO [StoreOpener-d639c76fe0fc5e2bc0d3271609b340ae-1] regionserver.HStore(310): Store=d639c76fe0fc5e2bc0d3271609b340ae/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,807 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,807 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened d639c76fe0fc5e2bc0d3271609b340ae; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70415475, jitterRate=0.04927234351634979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,807 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:45,817 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing d639c76fe0fc5e2bc0d3271609b340ae, disabling compactions & flushes 2023-02-15 21:01:45,817 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,817 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,817 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. after waiting 0 ms 2023-02-15 21:01:45,817 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,818 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:45,818 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:45,818 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,818 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,820 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,822 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:45,822 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1 2023-02-15 21:01:45,823 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a28c2d004072829dbe8cd24902bb9bb4 columnFamilyName f1 2023-02-15 21:01:45,826 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/testWithMockedMapReduceMultiRegion=a28c2d004072829dbe8cd24902bb9bb4-6387038f4d9a4da5b021cacbde118434 2023-02-15 21:01:45,826 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(310): Store=a28c2d004072829dbe8cd24902bb9bb4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,826 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:45,827 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2 2023-02-15 21:01:45,827 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a28c2d004072829dbe8cd24902bb9bb4 columnFamilyName f2 2023-02-15 21:01:45,830 DEBUG [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(539): loaded hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/testWithMockedMapReduceMultiRegion=a28c2d004072829dbe8cd24902bb9bb4-46ed49295b9c4d028cb0b14068caa4d5 2023-02-15 21:01:45,830 INFO [StoreOpener-a28c2d004072829dbe8cd24902bb9bb4-1] regionserver.HStore(310): Store=a28c2d004072829dbe8cd24902bb9bb4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,831 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,831 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened a28c2d004072829dbe8cd24902bb9bb4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75347179, jitterRate=0.12276045978069305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,831 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:45,838 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing a28c2d004072829dbe8cd24902bb9bb4, disabling compactions & flushes 2023-02-15 21:01:45,839 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,839 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,839 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. after waiting 0 ms 2023-02-15 21:01:45,839 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,839 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:45,839 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:45,840 DEBUG [Listener at localhost/45445] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:45,840 INFO [Listener at localhost/45445] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:45,843 DEBUG [Listener at localhost/45445] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:45,844 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:45,845 DEBUG [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f1 2023-02-15 21:01:45,846 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 970373a8437ef2b109dfc2507dd6a0d5 columnFamilyName f1 2023-02-15 21:01:45,846 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(310): Store=970373a8437ef2b109dfc2507dd6a0d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,846 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:45,847 DEBUG [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42911/user/jenkins/test-data/51028490-d1c4-03d1-a22c-60d1222ce1bc/testWithMockedMapReduceMultiRegion/aed6c620-9548-48d8-aa7c-1c88be9895e8/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f2 2023-02-15 21:01:45,848 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 970373a8437ef2b109dfc2507dd6a0d5 columnFamilyName f2 2023-02-15 21:01:45,848 INFO [StoreOpener-970373a8437ef2b109dfc2507dd6a0d5-1] regionserver.HStore(310): Store=970373a8437ef2b109dfc2507dd6a0d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:45,848 DEBUG [Listener at localhost/45445] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:45,848 INFO [Listener at localhost/45445] regionserver.HRegion(1071): Opened 970373a8437ef2b109dfc2507dd6a0d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73460319, jitterRate=0.09464405477046967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:45,848 DEBUG [Listener at localhost/45445] regionserver.HRegion(964): Region open journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:45,849 DEBUG [Listener at localhost/45445] regionserver.HRegion(1603): Closing 970373a8437ef2b109dfc2507dd6a0d5, disabling compactions & flushes 2023-02-15 21:01:45,849 INFO [Listener at localhost/45445] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,849 DEBUG [Listener at localhost/45445] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,849 DEBUG [Listener at localhost/45445] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. after waiting 0 ms 2023-02-15 21:01:45,849 DEBUG [Listener at localhost/45445] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,849 INFO [Listener at localhost/45445] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:45,849 DEBUG [Listener at localhost/45445] regionserver.HRegion(1557): Region close journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:45,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-15 21:01:45,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,857 INFO [Listener at localhost/45445] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:45,861 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494905861"}]},"ts":"1676494905861"} 2023-02-15 21:01:45,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:45,863 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-15 21:01:45,864 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-15 21:01:45,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, UNASSIGN}] 2023-02-15 21:01:45,867 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, UNASSIGN 2023-02-15 21:01:45,867 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, UNASSIGN 2023-02-15 21:01:45,867 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, UNASSIGN 2023-02-15 21:01:45,867 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, UNASSIGN 2023-02-15 21:01:45,868 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, UNASSIGN 2023-02-15 21:01:45,868 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d639c76fe0fc5e2bc0d3271609b340ae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:45,868 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=970373a8437ef2b109dfc2507dd6a0d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:45,868 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905868"}]},"ts":"1676494905868"} 2023-02-15 21:01:45,868 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=21b986cefae2cd41bcd81324d06c5c2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:45,868 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a28c2d004072829dbe8cd24902bb9bb4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:45,868 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494905868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905868"}]},"ts":"1676494905868"} 2023-02-15 21:01:45,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=163fcfc537af2d5a53badc6fadb408ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:45,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905868"}]},"ts":"1676494905868"} 2023-02-15 21:01:45,868 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905868"}]},"ts":"1676494905868"} 2023-02-15 21:01:45,869 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494905868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905868"}]},"ts":"1676494905868"} 2023-02-15 21:01:45,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure d639c76fe0fc5e2bc0d3271609b340ae, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:45,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 970373a8437ef2b109dfc2507dd6a0d5, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:45,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure a28c2d004072829dbe8cd24902bb9bb4, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:45,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=36, state=RUNNABLE; CloseRegionProcedure 21b986cefae2cd41bcd81324d06c5c2c, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:45,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 163fcfc537af2d5a53badc6fadb408ee, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:45,873 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, UNASSIGN 2023-02-15 21:01:45,873 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, UNASSIGN 2023-02-15 21:01:45,874 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ae43ae4c6bae75378d1f4bf9e63ea1c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:45,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905874"}]},"ts":"1676494905874"} 2023-02-15 21:01:45,874 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=91131e8ea09e93c79e45bbbfa440ceaf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:45,874 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905874"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905874"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905874"}]},"ts":"1676494905874"} 2023-02-15 21:01:45,875 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, UNASSIGN 2023-02-15 21:01:45,875 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, UNASSIGN 2023-02-15 21:01:45,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure ae43ae4c6bae75378d1f4bf9e63ea1c3, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:45,876 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=089cc74c3fe3bd73174bb55c58db69a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:45,876 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, UNASSIGN 2023-02-15 21:01:45,876 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905876"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905876"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905876"}]},"ts":"1676494905876"} 2023-02-15 21:01:45,877 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=a2e31c2d97427b77974af7210a896555, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:45,877 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676494902089.a2e31c2d97427b77974af7210a896555.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905877"}]},"ts":"1676494905877"} 2023-02-15 21:01:45,877 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=146c7fea6672c9fa55fb9aa7aceef411, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:45,877 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494905877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494905877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494905877"}]},"ts":"1676494905877"} 2023-02-15 21:01:45,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 91131e8ea09e93c79e45bbbfa440ceaf, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:45,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 089cc74c3fe3bd73174bb55c58db69a7, server=jenkins-hbase4.apache.org,34297,1676494900813}] 2023-02-15 21:01:45,883 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure a2e31c2d97427b77974af7210a896555, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:45,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 146c7fea6672c9fa55fb9aa7aceef411, server=jenkins-hbase4.apache.org,33701,1676494900842}] 2023-02-15 21:01:45,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:46,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:46,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 21b986cefae2cd41bcd81324d06c5c2c, disabling compactions & flushes 2023-02-15 21:01:46,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:46,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:46,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. after waiting 0 ms 2023-02-15 21:01:46,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:46,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:46,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 970373a8437ef2b109dfc2507dd6a0d5, disabling compactions & flushes 2023-02-15 21:01:46,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:46,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:46,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. after waiting 0 ms 2023-02-15 21:01:46,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:46,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 21:01:46,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5. 2023-02-15 21:01:46,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 970373a8437ef2b109dfc2507dd6a0d5: 2023-02-15 21:01:46,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c. 2023-02-15 21:01:46,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 21b986cefae2cd41bcd81324d06c5c2c: 2023-02-15 21:01:46,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:46,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:46,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ae43ae4c6bae75378d1f4bf9e63ea1c3, disabling compactions & flushes 2023-02-15 21:01:46,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. after waiting 0 ms 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:46,031 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=21b986cefae2cd41bcd81324d06c5c2c, regionState=CLOSED 2023-02-15 21:01:46,031 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906031"}]},"ts":"1676494906031"} 2023-02-15 21:01:46,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:46,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 163fcfc537af2d5a53badc6fadb408ee, disabling compactions & flushes 2023-02-15 21:01:46,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. after waiting 0 ms 2023-02-15 21:01:46,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:46,031 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=970373a8437ef2b109dfc2507dd6a0d5, regionState=CLOSED 2023-02-15 21:01:46,032 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494906031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906031"}]},"ts":"1676494906031"} 2023-02-15 21:01:46,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=36 2023-02-15 21:01:46,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=36, state=SUCCESS; CloseRegionProcedure 21b986cefae2cd41bcd81324d06c5c2c, server=jenkins-hbase4.apache.org,33701,1676494900842 in 160 msec 2023-02-15 21:01:46,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-15 21:01:46,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 970373a8437ef2b109dfc2507dd6a0d5, server=jenkins-hbase4.apache.org,34297,1676494900813 in 163 msec 2023-02-15 21:01:46,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21b986cefae2cd41bcd81324d06c5c2c, UNASSIGN in 169 msec 2023-02-15 21:01:46,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=970373a8437ef2b109dfc2507dd6a0d5, UNASSIGN in 169 msec 2023-02-15 21:01:46,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-15 21:01:46,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee. 2023-02-15 21:01:46,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 163fcfc537af2d5a53badc6fadb408ee: 2023-02-15 21:01:46,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3. 2023-02-15 21:01:46,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ae43ae4c6bae75378d1f4bf9e63ea1c3: 2023-02-15 21:01:46,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:46,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:46,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 91131e8ea09e93c79e45bbbfa440ceaf, disabling compactions & flushes 2023-02-15 21:01:46,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:46,041 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=163fcfc537af2d5a53badc6fadb408ee, regionState=CLOSED 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. after waiting 0 ms 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:46,041 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676494906041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906041"}]},"ts":"1676494906041"} 2023-02-15 21:01:46,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:46,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a2e31c2d97427b77974af7210a896555, disabling compactions & flushes 2023-02-15 21:01:46,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. after waiting 0 ms 2023-02-15 21:01:46,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:46,042 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ae43ae4c6bae75378d1f4bf9e63ea1c3, regionState=CLOSED 2023-02-15 21:01:46,042 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906041"}]},"ts":"1676494906041"} 2023-02-15 21:01:46,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-15 21:01:46,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 163fcfc537af2d5a53badc6fadb408ee, server=jenkins-hbase4.apache.org,34297,1676494900813 in 173 msec 2023-02-15 21:01:46,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-15 21:01:46,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure ae43ae4c6bae75378d1f4bf9e63ea1c3, server=jenkins-hbase4.apache.org,33701,1676494900842 in 170 msec 2023-02-15 21:01:46,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=163fcfc537af2d5a53badc6fadb408ee, UNASSIGN in 182 msec 2023-02-15 21:01:46,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=ae43ae4c6bae75378d1f4bf9e63ea1c3, UNASSIGN in 183 msec 2023-02-15 21:01:46,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555. 2023-02-15 21:01:46,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a2e31c2d97427b77974af7210a896555: 2023-02-15 21:01:46,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf. 2023-02-15 21:01:46,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 91131e8ea09e93c79e45bbbfa440ceaf: 2023-02-15 21:01:46,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:46,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:46,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 146c7fea6672c9fa55fb9aa7aceef411, disabling compactions & flushes 2023-02-15 21:01:46,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:46,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:46,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=a2e31c2d97427b77974af7210a896555, regionState=CLOSED 2023-02-15 21:01:46,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. after waiting 0 ms 2023-02-15 21:01:46,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:46,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676494902089.a2e31c2d97427b77974af7210a896555.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906051"}]},"ts":"1676494906051"} 2023-02-15 21:01:46,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:46,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:46,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 089cc74c3fe3bd73174bb55c58db69a7, disabling compactions & flushes 2023-02-15 21:01:46,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:46,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:46,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. after waiting 0 ms 2023-02-15 21:01:46,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:46,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=91131e8ea09e93c79e45bbbfa440ceaf, regionState=CLOSED 2023-02-15 21:01:46,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906052"}]},"ts":"1676494906052"} 2023-02-15 21:01:46,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-15 21:01:46,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure a2e31c2d97427b77974af7210a896555, server=jenkins-hbase4.apache.org,33701,1676494900842 in 173 msec 2023-02-15 21:01:46,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411. 2023-02-15 21:01:46,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 146c7fea6672c9fa55fb9aa7aceef411: 2023-02-15 21:01:46,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-15 21:01:46,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 91131e8ea09e93c79e45bbbfa440ceaf, server=jenkins-hbase4.apache.org,34297,1676494900813 in 176 msec 2023-02-15 21:01:46,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:46,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:46,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d639c76fe0fc5e2bc0d3271609b340ae, disabling compactions & flushes 2023-02-15 21:01:46,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:46,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:46,060 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=146c7fea6672c9fa55fb9aa7aceef411, regionState=CLOSED 2023-02-15 21:01:46,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a2e31c2d97427b77974af7210a896555, UNASSIGN in 190 msec 2023-02-15 21:01:46,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. after waiting 0 ms 2023-02-15 21:01:46,060 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906060"}]},"ts":"1676494906060"} 2023-02-15 21:01:46,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:46,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91131e8ea09e93c79e45bbbfa440ceaf, UNASSIGN in 194 msec 2023-02-15 21:01:46,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7. 2023-02-15 21:01:46,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 089cc74c3fe3bd73174bb55c58db69a7: 2023-02-15 21:01:46,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-15 21:01:46,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 146c7fea6672c9fa55fb9aa7aceef411, server=jenkins-hbase4.apache.org,33701,1676494900842 in 178 msec 2023-02-15 21:01:46,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:46,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:46,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a28c2d004072829dbe8cd24902bb9bb4, disabling compactions & flushes 2023-02-15 21:01:46,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:46,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:46,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. after waiting 0 ms 2023-02-15 21:01:46,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:46,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=089cc74c3fe3bd73174bb55c58db69a7, regionState=CLOSED 2023-02-15 21:01:46,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906065"}]},"ts":"1676494906065"} 2023-02-15 21:01:46,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=146c7fea6672c9fa55fb9aa7aceef411, UNASSIGN in 199 msec 2023-02-15 21:01:46,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae. 2023-02-15 21:01:46,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d639c76fe0fc5e2bc0d3271609b340ae: 2023-02-15 21:01:46,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:46,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=d639c76fe0fc5e2bc0d3271609b340ae, regionState=CLOSED 2023-02-15 21:01:46,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906068"}]},"ts":"1676494906068"} 2023-02-15 21:01:46,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-15 21:01:46,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 089cc74c3fe3bd73174bb55c58db69a7, server=jenkins-hbase4.apache.org,34297,1676494900813 in 188 msec 2023-02-15 21:01:46,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=089cc74c3fe3bd73174bb55c58db69a7, UNASSIGN in 203 msec 2023-02-15 21:01:46,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:46,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4. 2023-02-15 21:01:46,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a28c2d004072829dbe8cd24902bb9bb4: 2023-02-15 21:01:46,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-15 21:01:46,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure d639c76fe0fc5e2bc0d3271609b340ae, server=jenkins-hbase4.apache.org,33701,1676494900842 in 199 msec 2023-02-15 21:01:46,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:46,072 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a28c2d004072829dbe8cd24902bb9bb4, regionState=CLOSED 2023-02-15 21:01:46,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d639c76fe0fc5e2bc0d3271609b340ae, UNASSIGN in 206 msec 2023-02-15 21:01:46,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676494906072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494906072"}]},"ts":"1676494906072"} 2023-02-15 21:01:46,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-15 21:01:46,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure a28c2d004072829dbe8cd24902bb9bb4, server=jenkins-hbase4.apache.org,34297,1676494900813 in 202 msec 2023-02-15 21:01:46,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-15 21:01:46,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a28c2d004072829dbe8cd24902bb9bb4, UNASSIGN in 209 msec 2023-02-15 21:01:46,076 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494906076"}]},"ts":"1676494906076"} 2023-02-15 21:01:46,077 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-15 21:01:46,080 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-15 21:01:46,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 222 msec 2023-02-15 21:01:46,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-15 21:01:46,165 INFO [Listener at localhost/45445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-15 21:01:46,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,168 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,169 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:46,180 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:46,185 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/recovered.edits] 2023-02-15 21:01:46,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/recovered.edits] 2023-02-15 21:01:46,185 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/recovered.edits] 2023-02-15 21:01:46,186 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/recovered.edits] 2023-02-15 21:01:46,187 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/recovered.edits] 2023-02-15 21:01:46,187 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/recovered.edits] 2023-02-15 21:01:46,188 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/recovered.edits] 2023-02-15 21:01:46,188 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/recovered.edits] 2023-02-15 21:01:46,194 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/bcfc0a9164534e07af0ce48c38519cc3 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/bcfc0a9164534e07af0ce48c38519cc3 2023-02-15 21:01:46,194 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/4abc828df1fc4e7a8159af7824435c67 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/4abc828df1fc4e7a8159af7824435c67 2023-02-15 21:01:46,195 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/359794e8596b462fba9aef5f28a1cb9c to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/359794e8596b462fba9aef5f28a1cb9c 2023-02-15 21:01:46,195 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/15575efedb264cd0a73e275c006ae126 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/15575efedb264cd0a73e275c006ae126 2023-02-15 21:01:46,196 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/ff6056172ee0462994d922261afddba4 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f1/ff6056172ee0462994d922261afddba4 2023-02-15 21:01:46,197 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/b5770cc15f8144fbabde2f0880bd093b to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/b5770cc15f8144fbabde2f0880bd093b 2023-02-15 21:01:46,197 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/94b8015531d1465da54228ddee0af310 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f1/94b8015531d1465da54228ddee0af310 2023-02-15 21:01:46,197 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/6387038f4d9a4da5b021cacbde118434 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f1/6387038f4d9a4da5b021cacbde118434 2023-02-15 21:01:46,197 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/2a0bb7dfc070433c9072c404d7159738 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/2a0bb7dfc070433c9072c404d7159738 2023-02-15 21:01:46,197 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/15603d517e87473ab1210e0bafe7dafe to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/15603d517e87473ab1210e0bafe7dafe 2023-02-15 21:01:46,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/7a6818568bd14cb2aaa069165c14b074 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f1/7a6818568bd14cb2aaa069165c14b074 2023-02-15 21:01:46,199 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/recovered.edits/6.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5/recovered.edits/6.seqid 2023-02-15 21:01:46,200 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/970373a8437ef2b109dfc2507dd6a0d5 2023-02-15 21:01:46,200 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:46,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/fdb2434e31d747fa846f14687695b5ef to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f1/fdb2434e31d747fa846f14687695b5ef 2023-02-15 21:01:46,200 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/582e32df9ff3426995a7cb18e149c1f1 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f1/582e32df9ff3426995a7cb18e149c1f1 2023-02-15 21:01:46,200 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/52e318f41a1940dcaedea2260d43e099 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f1/52e318f41a1940dcaedea2260d43e099 2023-02-15 21:01:46,204 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/recovered.edits] 2023-02-15 21:01:46,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/94ab40bc3e59440ea62afbd82696ddd8 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/94ab40bc3e59440ea62afbd82696ddd8 2023-02-15 21:01:46,204 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/87d766c348fa4d24aea3188bc60130c8 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/87d766c348fa4d24aea3188bc60130c8 2023-02-15 21:01:46,205 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/46ed49295b9c4d028cb0b14068caa4d5 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/46ed49295b9c4d028cb0b14068caa4d5 2023-02-15 21:01:46,205 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/76da13f3b48741d4a15553d7faffb3a2 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/76da13f3b48741d4a15553d7faffb3a2 2023-02-15 21:01:46,206 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/be02406cf9a94d9e8d9c0b672e4bd786 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/f2/be02406cf9a94d9e8d9c0b672e4bd786 2023-02-15 21:01:46,206 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/4516483171744aec89cd1897f172993a to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/4516483171744aec89cd1897f172993a 2023-02-15 21:01:46,207 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/a736c51a46354127ae1ce8cfed1c3d8c to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/a736c51a46354127ae1ce8cfed1c3d8c 2023-02-15 21:01:46,207 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/51a9eaf316894db48cb8374bb0965c7d to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/51a9eaf316894db48cb8374bb0965c7d 2023-02-15 21:01:46,207 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/e3311a4af76549e7ae3c0fe0b0b64364 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/f2/e3311a4af76549e7ae3c0fe0b0b64364 2023-02-15 21:01:46,208 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/d276d3858eb348929ffdb2eb1639c01e to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/f2/d276d3858eb348929ffdb2eb1639c01e 2023-02-15 21:01:46,208 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/8649724a41ee4dfda95b7a3527618a7c to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/f2/8649724a41ee4dfda95b7a3527618a7c 2023-02-15 21:01:46,211 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/f6e3b0cc513446d8af77ad458c1662b5 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/f2/f6e3b0cc513446d8af77ad458c1662b5 2023-02-15 21:01:46,211 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/d73225b6885a4d0cb0bba8769ec4794e to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/f2/d73225b6885a4d0cb0bba8769ec4794e 2023-02-15 21:01:46,211 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/d3c70c69eabe408cb32130fa4247a058 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/f2/d3c70c69eabe408cb32130fa4247a058 2023-02-15 21:01:46,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/77c278f5e9354d54908a4d5685de6249 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/77c278f5e9354d54908a4d5685de6249 2023-02-15 21:01:46,215 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4/recovered.edits/12.seqid 2023-02-15 21:01:46,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411/recovered.edits/12.seqid 2023-02-15 21:01:46,217 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/b06882ef03c54c7bae24a0217d1cd36c to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f1/b06882ef03c54c7bae24a0217d1cd36c 2023-02-15 21:01:46,217 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf/recovered.edits/12.seqid 2023-02-15 21:01:46,217 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a28c2d004072829dbe8cd24902bb9bb4 2023-02-15 21:01:46,217 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:46,218 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/146c7fea6672c9fa55fb9aa7aceef411 2023-02-15 21:01:46,218 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/91131e8ea09e93c79e45bbbfa440ceaf 2023-02-15 21:01:46,218 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7/recovered.edits/12.seqid 2023-02-15 21:01:46,219 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c/recovered.edits/12.seqid 2023-02-15 21:01:46,218 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555/recovered.edits/12.seqid 2023-02-15 21:01:46,219 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae/recovered.edits/12.seqid 2023-02-15 21:01:46,220 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/a2e31c2d97427b77974af7210a896555 2023-02-15 21:01:46,220 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/21b986cefae2cd41bcd81324d06c5c2c 2023-02-15 21:01:46,220 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f1, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/f2, FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/recovered.edits] 2023-02-15 21:01:46,220 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/089cc74c3fe3bd73174bb55c58db69a7 2023-02-15 21:01:46,220 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/d639c76fe0fc5e2bc0d3271609b340ae 2023-02-15 21:01:46,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/535f45de58f44725a4bfeb72852ebe98 to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/535f45de58f44725a4bfeb72852ebe98 2023-02-15 21:01:46,223 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/ea0b9ddde75f46d6bea34399e619a99b to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/f2/ea0b9ddde75f46d6bea34399e619a99b 2023-02-15 21:01:46,227 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/recovered.edits/6.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee/recovered.edits/6.seqid 2023-02-15 21:01:46,227 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/recovered.edits/12.seqid to hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/archive/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3/recovered.edits/12.seqid 2023-02-15 21:01:46,227 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/163fcfc537af2d5a53badc6fadb408ee 2023-02-15 21:01:46,228 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/.tmp/data/default/testWithMockedMapReduceMultiRegion/ae43ae4c6bae75378d1f4bf9e63ea1c3 2023-02-15 21:01:46,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-15 21:01:46,230 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,233 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-15 21:01:46,235 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-15 21:01:46,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-15 21:01:46,236 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,236 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676494902089.a2e31c2d97427b77974af7210a896555.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494906236"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,239 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-15 21:01:46,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 970373a8437ef2b109dfc2507dd6a0d5, NAME => 'testWithMockedMapReduceMultiRegion,,1676494902089.970373a8437ef2b109dfc2507dd6a0d5.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => d639c76fe0fc5e2bc0d3271609b340ae, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676494902089.d639c76fe0fc5e2bc0d3271609b340ae.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 21b986cefae2cd41bcd81324d06c5c2c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676494902089.21b986cefae2cd41bcd81324d06c5c2c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => a28c2d004072829dbe8cd24902bb9bb4, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676494902089.a28c2d004072829dbe8cd24902bb9bb4.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 146c7fea6672c9fa55fb9aa7aceef411, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676494902089.146c7fea6672c9fa55fb9aa7aceef411.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => a2e31c2d97427b77974af7210a896555, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676494902089.a2e31c2d97427b77974af7210a896555.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 089cc74c3fe3bd73174bb55c58db69a7, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676494902089.089cc74c3fe3bd73174bb55c58db69a7.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 91131e8ea09e93c79e45bbbfa440ceaf, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676494902089.91131e8ea09e93c79e45bbbfa440ceaf.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => ae43ae4c6bae75378d1f4bf9e63ea1c3, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676494902089.ae43ae4c6bae75378d1f4bf9e63ea1c3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 163fcfc537af2d5a53badc6fadb408ee, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676494902089.163fcfc537af2d5a53badc6fadb408ee.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-15 21:01:46,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-15 21:01:46,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676494906239"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:46,240 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-15 21:01:46,242 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-15 21:01:46,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 76 msec 2023-02-15 21:01:46,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40009] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-15 21:01:46,271 INFO [Listener at localhost/45445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-15 21:01:46,271 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:01:46,272 INFO [Listener at localhost/45445] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:01:46,272 DEBUG [Listener at localhost/45445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x345e061f to 127.0.0.1:51615 2023-02-15 21:01:46,272 DEBUG [Listener at localhost/45445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,272 DEBUG [Listener at localhost/45445] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:01:46,272 DEBUG [Listener at localhost/45445] util.JVMClusterUtil(257): Found active master hash=1306748301, stopped=false 2023-02-15 21:01:46,272 INFO [Listener at localhost/45445] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:46,274 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:46,274 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:46,274 INFO [Listener at localhost/45445] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:01:46,274 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:46,274 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:46,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:46,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:46,276 DEBUG [Listener at localhost/45445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53e4eec3 to 127.0.0.1:51615 2023-02-15 21:01:46,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:46,276 DEBUG [Listener at localhost/45445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,277 INFO [Listener at localhost/45445] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34297,1676494900813' ***** 2023-02-15 21:01:46,277 INFO [Listener at localhost/45445] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:46,277 INFO [Listener at localhost/45445] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33701,1676494900842' ***** 2023-02-15 21:01:46,277 INFO [Listener at localhost/45445] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:46,277 INFO [RS:1;jenkins-hbase4:33701] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:46,277 INFO [RS:0;jenkins-hbase4:34297] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:46,277 INFO [RS:1;jenkins-hbase4:33701] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:46,277 INFO [RS:0;jenkins-hbase4:34297] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:46,277 INFO [RS:1;jenkins-hbase4:33701] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:46,277 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:46,277 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:46,278 DEBUG [RS:1;jenkins-hbase4:33701] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47011217 to 127.0.0.1:51615 2023-02-15 21:01:46,277 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:46,278 DEBUG [RS:1;jenkins-hbase4:33701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,277 INFO [RS:0;jenkins-hbase4:34297] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:46,279 INFO [RS:1;jenkins-hbase4:33701] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:46,279 INFO [RS:1;jenkins-hbase4:33701] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:46,279 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(3304): Received CLOSE for 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:46,279 INFO [RS:1;jenkins-hbase4:33701] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:46,279 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:46,279 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:01:46,279 DEBUG [RS:0;jenkins-hbase4:34297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a37ae55 to 127.0.0.1:51615 2023-02-15 21:01:46,280 DEBUG [RS:0;jenkins-hbase4:34297] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 760cdf8c5717711ed6e73dc1ce33693e, disabling compactions & flushes 2023-02-15 21:01:46,280 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 21:01:46,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:46,280 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 21:01:46,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:46,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:46,280 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 21:01:46,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:46,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. after waiting 0 ms 2023-02-15 21:01:46,282 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1479): Online Regions={760cdf8c5717711ed6e73dc1ce33693e=hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e.} 2023-02-15 21:01:46,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:46,283 DEBUG [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1505): Waiting on 760cdf8c5717711ed6e73dc1ce33693e 2023-02-15 21:01:46,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 760cdf8c5717711ed6e73dc1ce33693e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:01:46,283 DEBUG [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 21:01:46,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:46,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:46,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:46,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-15 21:01:46,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/.tmp/info/ac62a089817c44e3a0352a2467506787 2023-02-15 21:01:46,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/.tmp/info/86e1bac107124177884e2ccb2022a4df 2023-02-15 21:01:46,296 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86e1bac107124177884e2ccb2022a4df 2023-02-15 21:01:46,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/.tmp/info/ac62a089817c44e3a0352a2467506787 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/info/ac62a089817c44e3a0352a2467506787 2023-02-15 21:01:46,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/info/ac62a089817c44e3a0352a2467506787, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:01:46,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 760cdf8c5717711ed6e73dc1ce33693e in 18ms, sequenceid=6, compaction requested=false 2023-02-15 21:01:46,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/.tmp/rep_barrier/dff6cef1601a4d3d919e2271fa5eaddf 2023-02-15 21:01:46,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/namespace/760cdf8c5717711ed6e73dc1ce33693e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:01:46,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:46,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 760cdf8c5717711ed6e73dc1ce33693e: 2023-02-15 21:01:46,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494901479.760cdf8c5717711ed6e73dc1ce33693e. 2023-02-15 21:01:46,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dff6cef1601a4d3d919e2271fa5eaddf 2023-02-15 21:01:46,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/.tmp/table/0fc1e1494d2c45298eb55b0ce1a9617d 2023-02-15 21:01:46,325 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:46,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fc1e1494d2c45298eb55b0ce1a9617d 2023-02-15 21:01:46,328 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/.tmp/info/86e1bac107124177884e2ccb2022a4df as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/info/86e1bac107124177884e2ccb2022a4df 2023-02-15 21:01:46,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86e1bac107124177884e2ccb2022a4df 2023-02-15 21:01:46,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/info/86e1bac107124177884e2ccb2022a4df, entries=30, sequenceid=57, filesize=8.3 K 2023-02-15 21:01:46,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/.tmp/rep_barrier/dff6cef1601a4d3d919e2271fa5eaddf as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/rep_barrier/dff6cef1601a4d3d919e2271fa5eaddf 2023-02-15 21:01:46,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dff6cef1601a4d3d919e2271fa5eaddf 2023-02-15 21:01:46,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/rep_barrier/dff6cef1601a4d3d919e2271fa5eaddf, entries=10, sequenceid=57, filesize=6.1 K 2023-02-15 21:01:46,338 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/.tmp/table/0fc1e1494d2c45298eb55b0ce1a9617d as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/table/0fc1e1494d2c45298eb55b0ce1a9617d 2023-02-15 21:01:46,341 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:46,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fc1e1494d2c45298eb55b0ce1a9617d 2023-02-15 21:01:46,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/table/0fc1e1494d2c45298eb55b0ce1a9617d, entries=13, sequenceid=57, filesize=6.1 K 2023-02-15 21:01:46,343 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=57, compaction requested=false 2023-02-15 21:01:46,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-15 21:01:46,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:46,348 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:46,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:46,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:46,483 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34297,1676494900813; all regions closed. 2023-02-15 21:01:46,483 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33701,1676494900842; all regions closed. 2023-02-15 21:01:46,488 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/WALs/jenkins-hbase4.apache.org,33701,1676494900842/jenkins-hbase4.apache.org%2C33701%2C1676494900842.meta.1676494901418.meta not finished, retry = 0 2023-02-15 21:01:46,489 DEBUG [RS:0;jenkins-hbase4:34297] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/oldWALs 2023-02-15 21:01:46,489 INFO [RS:0;jenkins-hbase4:34297] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34297%2C1676494900813:(num 1676494901847) 2023-02-15 21:01:46,489 DEBUG [RS:0;jenkins-hbase4:34297] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,490 INFO [RS:0;jenkins-hbase4:34297] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:46,490 INFO [RS:0;jenkins-hbase4:34297] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:46,490 INFO [RS:0;jenkins-hbase4:34297] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:46,490 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:46,490 INFO [RS:0;jenkins-hbase4:34297] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:46,490 INFO [RS:0;jenkins-hbase4:34297] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:46,491 INFO [RS:0;jenkins-hbase4:34297] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34297 2023-02-15 21:01:46,492 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:46,492 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34297,1676494900813 2023-02-15 21:01:46,493 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:46,493 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e6c2734 rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,492 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:46,493 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:46,493 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@116e34e3 rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,494 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34297,1676494900813] 2023-02-15 21:01:46,494 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34297,1676494900813; numProcessing=1 2023-02-15 21:01:46,495 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34297,1676494900813 already deleted, retry=false 2023-02-15 21:01:46,495 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34297,1676494900813 expired; onlineServers=1 2023-02-15 21:01:46,590 DEBUG [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/oldWALs 2023-02-15 21:01:46,591 INFO [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33701%2C1676494900842.meta:.meta(num 1676494901418) 2023-02-15 21:01:46,595 DEBUG [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/oldWALs 2023-02-15 21:01:46,595 INFO [RS:1;jenkins-hbase4:33701] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33701%2C1676494900842:(num 1676494902156) 2023-02-15 21:01:46,595 DEBUG [RS:1;jenkins-hbase4:33701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,595 INFO [RS:1;jenkins-hbase4:33701] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:46,595 INFO [RS:1;jenkins-hbase4:33701] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:46,595 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:46,596 INFO [RS:1;jenkins-hbase4:33701] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33701 2023-02-15 21:01:46,598 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33701,1676494900842 2023-02-15 21:01:46,598 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:46,598 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fcaa676 rejected from java.util.concurrent.ThreadPoolExecutor@3bf52557[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,599 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33701,1676494900842] 2023-02-15 21:01:46,599 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33701,1676494900842; numProcessing=2 2023-02-15 21:01:46,601 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33701,1676494900842 already deleted, retry=false 2023-02-15 21:01:46,601 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33701,1676494900842 expired; onlineServers=0 2023-02-15 21:01:46,601 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40009,1676494900769' ***** 2023-02-15 21:01:46,601 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:01:46,602 DEBUG [M:0;jenkins-hbase4:40009] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49dce8e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:46,602 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40009,1676494900769 2023-02-15 21:01:46,602 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40009,1676494900769; all regions closed. 2023-02-15 21:01:46,602 DEBUG [M:0;jenkins-hbase4:40009] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:46,602 DEBUG [M:0;jenkins-hbase4:40009] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:01:46,602 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:01:46,602 DEBUG [M:0;jenkins-hbase4:40009] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:01:46,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494901035] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494901035,5,FailOnTimeoutGroup] 2023-02-15 21:01:46,602 INFO [M:0;jenkins-hbase4:40009] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:01:46,603 INFO [M:0;jenkins-hbase4:40009] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:01:46,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494901035] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494901035,5,FailOnTimeoutGroup] 2023-02-15 21:01:46,603 INFO [M:0;jenkins-hbase4:40009] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:01:46,603 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:46,603 DEBUG [M:0;jenkins-hbase4:40009] master.HMaster(1512): Stopping service threads 2023-02-15 21:01:46,603 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:46,603 INFO [M:0;jenkins-hbase4:40009] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:01:46,604 ERROR [M:0;jenkins-hbase4:40009] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 21:01:46,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:46,604 INFO [M:0;jenkins-hbase4:40009] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:01:46,605 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:01:46,605 DEBUG [M:0;jenkins-hbase4:40009] zookeeper.ZKUtil(398): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:01:46,605 WARN [M:0;jenkins-hbase4:40009] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:01:46,605 INFO [M:0;jenkins-hbase4:40009] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:01:46,605 INFO [M:0;jenkins-hbase4:40009] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:01:46,605 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:46,606 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:46,606 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:46,606 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:46,606 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:46,606 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-15 21:01:46,614 INFO [M:0;jenkins-hbase4:40009] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c742aee19eaf4866a8255c58b5e4f6f5 2023-02-15 21:01:46,618 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c742aee19eaf4866a8255c58b5e4f6f5 as hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c742aee19eaf4866a8255c58b5e4f6f5 2023-02-15 21:01:46,622 INFO [M:0;jenkins-hbase4:40009] regionserver.HStore(1080): Added hdfs://localhost:42911/user/jenkins/test-data/1c67e0f3-51fe-a846-a6c9-3f34b2de811c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c742aee19eaf4866a8255c58b5e4f6f5, entries=53, sequenceid=357, filesize=10.7 K 2023-02-15 21:01:46,623 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-15 21:01:46,624 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:46,624 DEBUG [M:0;jenkins-hbase4:40009] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:46,626 INFO [M:0;jenkins-hbase4:40009] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:01:46,626 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:46,627 INFO [M:0;jenkins-hbase4:40009] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40009 2023-02-15 21:01:46,630 DEBUG [M:0;jenkins-hbase4:40009] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40009,1676494900769 already deleted, retry=false 2023-02-15 21:01:46,777 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:46,777 INFO [M:0;jenkins-hbase4:40009] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40009,1676494900769; zookeeper connection closed. 2023-02-15 21:01:46,777 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e1dd612 rejected from java.util.concurrent.ThreadPoolExecutor@3a225509[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,778 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): master:40009-0x10059c9f7d30000, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:46,778 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e680c42 rejected from java.util.concurrent.ThreadPoolExecutor@3a225509[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,877 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:46,877 INFO [RS:1;jenkins-hbase4:33701] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33701,1676494900842; zookeeper connection closed. 2023-02-15 21:01:46,877 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2550a9c2 rejected from java.util.concurrent.ThreadPoolExecutor@3bf52557[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,877 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1bf40554] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1bf40554 2023-02-15 21:01:46,877 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:33701-0x10059c9f7d30002, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:46,877 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d8e093a rejected from java.util.concurrent.ThreadPoolExecutor@3bf52557[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,977 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:46,977 INFO [RS:0;jenkins-hbase4:34297] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34297,1676494900813; zookeeper connection closed. 2023-02-15 21:01:46,977 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6931b33c rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,978 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a96db00] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a96db00 2023-02-15 21:01:46,978 DEBUG [Listener at localhost/45445-EventThread] zookeeper.ZKWatcher(600): regionserver:34297-0x10059c9f7d30001, quorum=127.0.0.1:51615, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:46,978 ERROR [Listener at localhost/45445-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f573460 rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:46,978 INFO [Listener at localhost/45445] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:01:46,979 WARN [Listener at localhost/45445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:46,982 INFO [Listener at localhost/45445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:47,085 WARN [BP-884803332-172.31.14.131-1676494900203 heartbeating to localhost/127.0.0.1:42911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:47,088 WARN [BP-884803332-172.31.14.131-1676494900203 heartbeating to localhost/127.0.0.1:42911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-884803332-172.31.14.131-1676494900203 (Datanode Uuid 43d0ab47-fc7f-463d-afe6-70370e45065c) service to localhost/127.0.0.1:42911 2023-02-15 21:01:47,090 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/dfs/data/data3/current/BP-884803332-172.31.14.131-1676494900203] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:47,090 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/dfs/data/data4/current/BP-884803332-172.31.14.131-1676494900203] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:47,092 WARN [Listener at localhost/45445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:47,095 INFO [Listener at localhost/45445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:47,201 WARN [BP-884803332-172.31.14.131-1676494900203 heartbeating to localhost/127.0.0.1:42911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:47,202 WARN [BP-884803332-172.31.14.131-1676494900203 heartbeating to localhost/127.0.0.1:42911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-884803332-172.31.14.131-1676494900203 (Datanode Uuid 5e4faa00-a5ca-42cb-b0db-23040cca9975) service to localhost/127.0.0.1:42911 2023-02-15 21:01:47,204 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/dfs/data/data1/current/BP-884803332-172.31.14.131-1676494900203] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:47,204 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/cluster_a6bdae3b-e42e-9b2e-cc27-1765c20158e9/dfs/data/data2/current/BP-884803332-172.31.14.131-1676494900203] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:47,214 INFO [Listener at localhost/45445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:47,333 INFO [Listener at localhost/45445] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:01:47,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 21:01:47,379 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:01:47,398 INFO [Listener at localhost/45445] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 181) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:42911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42911 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:42911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42911 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40009,1676494900769)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42911 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42911 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45445.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=637 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 317), ProcessCount=166 (was 166), AvailableMemoryMB=2744 (was 2788) 2023-02-15 21:01:47,410 INFO [Listener at localhost/45445] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=166, AvailableMemoryMB=2744 2023-02-15 21:01:47,425 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/hadoop.log.dir so I do NOT create it in target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70 2023-02-15 21:01:47,426 WARN [Listener at localhost/45445] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 21:01:47,426 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/hadoop.tmp.dir so I do NOT create it in target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70 2023-02-15 21:01:47,426 WARN [Listener at localhost/45445] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9135a4a5-36af-120a-1cc4-199b1c6b0180/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 21:01:47,426 DEBUG [Listener at localhost/45445] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70 2023-02-15 21:01:47,426 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:47,426 INFO [Listener at localhost/45445] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532, deleteOnExit=true 2023-02-15 21:01:47,426 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:47,426 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/test.cache.data in system properties and HBase conf 2023-02-15 21:01:47,427 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:47,427 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:47,427 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:47,427 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:47,427 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:47,427 DEBUG [Listener at localhost/45445] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:47,428 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:47,428 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:47,428 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:47,428 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:47,428 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:47,429 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:47,430 INFO [Listener at localhost/45445] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:47,434 WARN [Listener at localhost/45445] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:47,435 WARN [Listener at localhost/45445] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:47,518 WARN [Listener at localhost/45445] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:47,521 INFO [Listener at localhost/45445] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:47,526 INFO [Listener at localhost/45445] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/java.io.tmpdir/Jetty_localhost_43789_hdfs____.pwtewt/webapp 2023-02-15 21:01:47,618 INFO [Listener at localhost/45445] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43789 2023-02-15 21:01:47,622 WARN [Listener at localhost/45445] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:47,622 WARN [Listener at localhost/45445] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:47,665 WARN [Listener at localhost/45265] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:47,681 WARN [Listener at localhost/45265] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:47,683 WARN [Listener at localhost/45265] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:47,684 INFO [Listener at localhost/45265] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:47,689 INFO [Listener at localhost/45265] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/java.io.tmpdir/Jetty_localhost_38065_datanode____.95jovj/webapp 2023-02-15 21:01:47,781 INFO [Listener at localhost/45265] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38065 2023-02-15 21:01:47,793 WARN [Listener at localhost/44217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:47,811 WARN [Listener at localhost/44217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:47,812 WARN [Listener at localhost/44217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:47,813 INFO [Listener at localhost/44217] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:47,818 INFO [Listener at localhost/44217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/java.io.tmpdir/Jetty_localhost_34637_datanode____.ni31c0/webapp 2023-02-15 21:01:47,905 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbfe971c5df52a5be: Processing first storage report for DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc from datanode 59fb5855-5d2b-4889-bd2d-23610aa0d982 2023-02-15 21:01:47,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbfe971c5df52a5be: from storage DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc node DatanodeRegistration(127.0.0.1:44995, datanodeUuid=59fb5855-5d2b-4889-bd2d-23610aa0d982, infoPort=35707, infoSecurePort=0, ipcPort=44217, storageInfo=lv=-57;cid=testClusterID;nsid=122887736;c=1676494907442), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:47,906 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbfe971c5df52a5be: Processing first storage report for DS-8886e773-ee3f-4446-9f4a-86ab4e3dbd2e from datanode 59fb5855-5d2b-4889-bd2d-23610aa0d982 2023-02-15 21:01:47,906 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbfe971c5df52a5be: from storage DS-8886e773-ee3f-4446-9f4a-86ab4e3dbd2e node DatanodeRegistration(127.0.0.1:44995, datanodeUuid=59fb5855-5d2b-4889-bd2d-23610aa0d982, infoPort=35707, infoSecurePort=0, ipcPort=44217, storageInfo=lv=-57;cid=testClusterID;nsid=122887736;c=1676494907442), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:47,930 INFO [Listener at localhost/44217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34637 2023-02-15 21:01:47,940 WARN [Listener at localhost/35313] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:48,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69f37bed8f37e523: Processing first storage report for DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4 from datanode e6549a5c-d6db-4c79-8d02-186e999faa20 2023-02-15 21:01:48,037 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69f37bed8f37e523: from storage DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4 node DatanodeRegistration(127.0.0.1:35277, datanodeUuid=e6549a5c-d6db-4c79-8d02-186e999faa20, infoPort=33761, infoSecurePort=0, ipcPort=35313, storageInfo=lv=-57;cid=testClusterID;nsid=122887736;c=1676494907442), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:48,037 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69f37bed8f37e523: Processing first storage report for DS-760425f9-50ed-4f94-87d1-8817b62e0258 from datanode e6549a5c-d6db-4c79-8d02-186e999faa20 2023-02-15 21:01:48,037 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69f37bed8f37e523: from storage DS-760425f9-50ed-4f94-87d1-8817b62e0258 node DatanodeRegistration(127.0.0.1:35277, datanodeUuid=e6549a5c-d6db-4c79-8d02-186e999faa20, infoPort=33761, infoSecurePort=0, ipcPort=35313, storageInfo=lv=-57;cid=testClusterID;nsid=122887736;c=1676494907442), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:48,046 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70 2023-02-15 21:01:48,048 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/zookeeper_0, clientPort=57917, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:48,049 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57917 2023-02-15 21:01:48,049 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,050 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,063 INFO [Listener at localhost/35313] util.FSUtils(479): Created version file at hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4 with version=8 2023-02-15 21:01:48,063 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,064 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,065 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/hbase-staging 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:48,067 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:48,068 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34587 2023-02-15 21:01:48,068 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,069 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,070 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34587 connecting to ZooKeeper ensemble=127.0.0.1:57917 2023-02-15 21:01:48,077 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:345870x0, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:48,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34587-0x10059ca14540000 connected 2023-02-15 21:01:48,095 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:48,095 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:48,095 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:48,096 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34587 2023-02-15 21:01:48,096 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34587 2023-02-15 21:01:48,096 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34587 2023-02-15 21:01:48,100 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34587 2023-02-15 21:01:48,102 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34587 2023-02-15 21:01:48,102 INFO [Listener at localhost/35313] master.HMaster(444): hbase.rootdir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4, hbase.cluster.distributed=false 2023-02-15 21:01:48,114 INFO [Listener at localhost/35313] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:48,114 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,114 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,114 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:48,114 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,114 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:48,115 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:48,115 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33031 2023-02-15 21:01:48,116 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:48,118 DEBUG [Listener at localhost/35313] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:48,118 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,119 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,120 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33031 connecting to ZooKeeper ensemble=127.0.0.1:57917 2023-02-15 21:01:48,123 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:330310x0, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:48,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33031-0x10059ca14540001 connected 2023-02-15 21:01:48,125 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:48,125 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:48,126 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:48,128 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33031 2023-02-15 21:01:48,128 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33031 2023-02-15 21:01:48,128 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33031 2023-02-15 21:01:48,129 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33031 2023-02-15 21:01:48,129 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33031 2023-02-15 21:01:48,139 INFO [Listener at localhost/35313] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:48,140 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,140 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,140 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:48,140 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:48,140 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:48,140 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:48,144 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46729 2023-02-15 21:01:48,144 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:48,147 DEBUG [Listener at localhost/35313] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:48,148 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,149 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,149 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46729 connecting to ZooKeeper ensemble=127.0.0.1:57917 2023-02-15 21:01:48,154 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:467290x0, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:48,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46729-0x10059ca14540002 connected 2023-02-15 21:01:48,156 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:48,157 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:48,157 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:48,157 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46729 2023-02-15 21:01:48,157 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46729 2023-02-15 21:01:48,160 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46729 2023-02-15 21:01:48,161 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46729 2023-02-15 21:01:48,162 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46729 2023-02-15 21:01:48,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,167 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:48,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,168 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:48,168 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:48,168 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:48,169 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:48,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34587,1676494908066 from backup master directory 2023-02-15 21:01:48,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:48,172 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,173 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:48,173 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:48,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/hbase.id with ID: 2e331308-8ec7-4a60-ae3f-9fe5a551d74b 2023-02-15 21:01:48,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:48,195 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x18b08e62 to 127.0.0.1:57917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:48,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3244c8a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:48,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:48,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:48,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:48,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store-tmp 2023-02-15 21:01:48,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:48,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:48,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:48,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:48,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:48,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:48,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:48,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:48,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/WALs/jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34587%2C1676494908066, suffix=, logDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/WALs/jenkins-hbase4.apache.org,34587,1676494908066, archiveDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:48,246 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK] 2023-02-15 21:01:48,246 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK] 2023-02-15 21:01:48,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/WALs/jenkins-hbase4.apache.org,34587,1676494908066/jenkins-hbase4.apache.org%2C34587%2C1676494908066.1676494908232 2023-02-15 21:01:48,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK], DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK]] 2023-02-15 21:01:48,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:48,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:48,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:48,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:48,249 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:48,250 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:48,251 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:48,251 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:48,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:48,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:48,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:48,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74299482, jitterRate=0.10714855790138245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:48,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:48,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:48,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:48,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:48,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:48,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 21:01:48,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 21:01:48,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:48,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:48,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:48,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:48,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:48,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:48,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:48,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:48,274 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:48,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:48,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:48,277 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:48,277 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:48,277 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:48,277 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34587,1676494908066, sessionid=0x10059ca14540000, setting cluster-up flag (Was=false) 2023-02-15 21:01:48,283 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:48,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,290 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:48,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:48,295 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.hbase-snapshot/.tmp 2023-02-15 21:01:48,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:48,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494938299 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:48,299 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:48,299 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:48,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:48,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:48,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:48,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:48,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:48,301 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:48,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494908301,5,FailOnTimeoutGroup] 2023-02-15 21:01:48,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494908304,5,FailOnTimeoutGroup] 2023-02-15 21:01:48,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:48,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,312 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:48,313 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:48,313 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4 2023-02-15 21:01:48,320 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:48,324 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:48,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/info 2023-02-15 21:01:48,326 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:48,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:48,327 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:48,328 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:48,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:48,329 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/table 2023-02-15 21:01:48,329 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:48,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,330 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740 2023-02-15 21:01:48,331 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740 2023-02-15 21:01:48,332 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:48,333 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:48,336 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:48,337 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68810751, jitterRate=0.025360092520713806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:48,337 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:48,337 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:48,337 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:48,337 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:48,337 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:48,337 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:48,337 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:48,337 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:48,338 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:48,338 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:48,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:48,340 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:48,341 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:48,365 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(952): ClusterId : 2e331308-8ec7-4a60-ae3f-9fe5a551d74b 2023-02-15 21:01:48,365 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(952): ClusterId : 2e331308-8ec7-4a60-ae3f-9fe5a551d74b 2023-02-15 21:01:48,365 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:48,365 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:48,367 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:48,367 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:48,367 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:48,367 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:48,375 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:48,375 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:48,377 DEBUG [RS:1;jenkins-hbase4:46729] zookeeper.ReadOnlyZKClient(139): Connect 0x54b58bd2 to 127.0.0.1:57917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:48,377 DEBUG [RS:0;jenkins-hbase4:33031] zookeeper.ReadOnlyZKClient(139): Connect 0x0355e194 to 127.0.0.1:57917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:48,382 DEBUG [RS:1;jenkins-hbase4:46729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a727f34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:48,382 DEBUG [RS:0;jenkins-hbase4:33031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d920f8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:48,382 DEBUG [RS:1;jenkins-hbase4:46729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e4de0a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:48,383 DEBUG [RS:0;jenkins-hbase4:33031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9ad8ae4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:48,391 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33031 2023-02-15 21:01:48,391 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46729 2023-02-15 21:01:48,391 INFO [RS:0;jenkins-hbase4:33031] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:48,391 INFO [RS:0;jenkins-hbase4:33031] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:48,391 INFO [RS:1;jenkins-hbase4:46729] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:48,391 INFO [RS:1;jenkins-hbase4:46729] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:48,391 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:48,391 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:48,392 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34587,1676494908066 with isa=jenkins-hbase4.apache.org/172.31.14.131:33031, startcode=1676494908114 2023-02-15 21:01:48,392 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34587,1676494908066 with isa=jenkins-hbase4.apache.org/172.31.14.131:46729, startcode=1676494908139 2023-02-15 21:01:48,392 DEBUG [RS:0;jenkins-hbase4:33031] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:48,392 DEBUG [RS:1;jenkins-hbase4:46729] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:48,394 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49363, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:48,394 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33719, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:48,395 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34587] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,396 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4 2023-02-15 21:01:48,396 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45265 2023-02-15 21:01:48,396 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4 2023-02-15 21:01:48,396 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:48,396 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45265 2023-02-15 21:01:48,396 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:48,402 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:48,402 DEBUG [RS:0;jenkins-hbase4:33031] zookeeper.ZKUtil(162): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,402 DEBUG [RS:1;jenkins-hbase4:46729] zookeeper.ZKUtil(162): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,403 WARN [RS:0;jenkins-hbase4:33031] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:48,403 WARN [RS:1;jenkins-hbase4:46729] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:48,403 INFO [RS:0;jenkins-hbase4:33031] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:48,403 INFO [RS:1;jenkins-hbase4:46729] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:48,403 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,403 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,403 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46729,1676494908139] 2023-02-15 21:01:48,403 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33031,1676494908114] 2023-02-15 21:01:48,409 DEBUG [RS:1;jenkins-hbase4:46729] zookeeper.ZKUtil(162): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,409 DEBUG [RS:0;jenkins-hbase4:33031] zookeeper.ZKUtil(162): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,409 DEBUG [RS:1;jenkins-hbase4:46729] zookeeper.ZKUtil(162): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,409 DEBUG [RS:0;jenkins-hbase4:33031] zookeeper.ZKUtil(162): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,410 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:48,410 DEBUG [RS:0;jenkins-hbase4:33031] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:48,410 INFO [RS:1;jenkins-hbase4:46729] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:48,410 INFO [RS:0;jenkins-hbase4:33031] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:48,411 INFO [RS:1;jenkins-hbase4:46729] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:48,411 INFO [RS:1;jenkins-hbase4:46729] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:48,411 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,411 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:48,413 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,413 INFO [RS:0;jenkins-hbase4:33031] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,413 INFO [RS:0;jenkins-hbase4:33031] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,413 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,413 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,414 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:48,414 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,414 DEBUG [RS:1;jenkins-hbase4:46729] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,417 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,417 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,417 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,417 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,417 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,418 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,418 DEBUG [RS:0;jenkins-hbase4:33031] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:48,420 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,421 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,421 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,432 INFO [RS:1;jenkins-hbase4:46729] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:48,432 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46729,1676494908139-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,434 INFO [RS:0;jenkins-hbase4:33031] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:48,434 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33031,1676494908114-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,443 INFO [RS:1;jenkins-hbase4:46729] regionserver.Replication(203): jenkins-hbase4.apache.org,46729,1676494908139 started 2023-02-15 21:01:48,443 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46729,1676494908139, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46729, sessionid=0x10059ca14540002 2023-02-15 21:01:48,443 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:48,443 DEBUG [RS:1;jenkins-hbase4:46729] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,443 DEBUG [RS:1;jenkins-hbase4:46729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46729,1676494908139' 2023-02-15 21:01:48,443 DEBUG [RS:1;jenkins-hbase4:46729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:48,443 DEBUG [RS:1;jenkins-hbase4:46729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46729,1676494908139' 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:48,444 DEBUG [RS:1;jenkins-hbase4:46729] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:48,444 INFO [RS:1;jenkins-hbase4:46729] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:48,444 INFO [RS:1;jenkins-hbase4:46729] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:48,444 INFO [RS:0;jenkins-hbase4:33031] regionserver.Replication(203): jenkins-hbase4.apache.org,33031,1676494908114 started 2023-02-15 21:01:48,445 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33031,1676494908114, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33031, sessionid=0x10059ca14540001 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33031,1676494908114' 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33031,1676494908114' 2023-02-15 21:01:48,445 DEBUG [RS:0;jenkins-hbase4:33031] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:48,446 DEBUG [RS:0;jenkins-hbase4:33031] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:48,446 DEBUG [RS:0;jenkins-hbase4:33031] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:48,446 INFO [RS:0;jenkins-hbase4:33031] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:48,446 INFO [RS:0;jenkins-hbase4:33031] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:48,491 DEBUG [jenkins-hbase4:34587] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:48,491 DEBUG [jenkins-hbase4:34587] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:48,493 DEBUG [jenkins-hbase4:34587] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:48,493 DEBUG [jenkins-hbase4:34587] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:48,493 DEBUG [jenkins-hbase4:34587] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:48,493 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46729,1676494908139, state=OPENING 2023-02-15 21:01:48,494 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:48,495 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:48,496 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:48,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46729,1676494908139}] 2023-02-15 21:01:48,652 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,652 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:48,654 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53418, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:48,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:48,658 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:48,659 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46729%2C1676494908139.meta, suffix=.meta, logDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,46729,1676494908139, archiveDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/oldWALs, maxLogs=32 2023-02-15 21:01:48,672 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK] 2023-02-15 21:01:48,672 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK] 2023-02-15 21:01:48,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,46729,1676494908139/jenkins-hbase4.apache.org%2C46729%2C1676494908139.meta.1676494908659.meta 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK], DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK]] 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:48,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:48,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:48,675 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:48,676 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/info 2023-02-15 21:01:48,676 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/info 2023-02-15 21:01:48,677 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:48,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:48,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:48,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:48,678 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:48,678 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,678 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:48,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/table 2023-02-15 21:01:48,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/table 2023-02-15 21:01:48,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:48,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:48,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740 2023-02-15 21:01:48,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740 2023-02-15 21:01:48,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:48,683 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:48,684 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61178800, jitterRate=-0.08836483955383301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:48,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:48,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494908652 2023-02-15 21:01:48,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:48,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:48,688 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46729,1676494908139, state=OPEN 2023-02-15 21:01:48,690 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:48,690 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:48,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:48,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46729,1676494908139 in 194 msec 2023-02-15 21:01:48,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:48,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-15 21:01:48,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-15 21:01:48,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494908693, completionTime=-1 2023-02-15 21:01:48,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:48,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:48,696 DEBUG [hconnection-0x5191b10c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:48,697 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:48,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:48,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494968699 2023-02-15 21:01:48,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676495028699 2023-02-15 21:01:48,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 21:01:48,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34587,1676494908066-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34587,1676494908066-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34587,1676494908066-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34587, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:48,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:48,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:48,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:48,709 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:48,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:48,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:48,711 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:48,711 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4 empty. 2023-02-15 21:01:48,711 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:48,712 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:48,723 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:48,724 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0161aa34cb75266f8e6e79341bf1a5b4, NAME => 'hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp 2023-02-15 21:01:48,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:48,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 0161aa34cb75266f8e6e79341bf1a5b4, disabling compactions & flushes 2023-02-15 21:01:48,734 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:48,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:48,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. after waiting 0 ms 2023-02-15 21:01:48,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:48,734 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:48,734 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 0161aa34cb75266f8e6e79341bf1a5b4: 2023-02-15 21:01:48,736 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:48,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494908736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494908736"}]},"ts":"1676494908736"} 2023-02-15 21:01:48,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:48,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:48,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494908739"}]},"ts":"1676494908739"} 2023-02-15 21:01:48,741 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:48,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:48,744 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:48,744 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:48,744 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:48,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0161aa34cb75266f8e6e79341bf1a5b4, ASSIGN}] 2023-02-15 21:01:48,746 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0161aa34cb75266f8e6e79341bf1a5b4, ASSIGN 2023-02-15 21:01:48,746 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0161aa34cb75266f8e6e79341bf1a5b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46729,1676494908139; forceNewPlan=false, retain=false 2023-02-15 21:01:48,897 INFO [jenkins-hbase4:34587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:48,897 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0161aa34cb75266f8e6e79341bf1a5b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:48,897 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494908897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494908897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494908897"}]},"ts":"1676494908897"} 2023-02-15 21:01:48,899 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0161aa34cb75266f8e6e79341bf1a5b4, server=jenkins-hbase4.apache.org,46729,1676494908139}] 2023-02-15 21:01:49,053 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:49,054 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46729%2C1676494908139, suffix=, logDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,46729,1676494908139, archiveDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/oldWALs, maxLogs=32 2023-02-15 21:01:49,067 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK] 2023-02-15 21:01:49,067 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK] 2023-02-15 21:01:49,069 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,46729,1676494908139/jenkins-hbase4.apache.org%2C46729%2C1676494908139.1676494909055 2023-02-15 21:01:49,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK], DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK]] 2023-02-15 21:01:49,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0161aa34cb75266f8e6e79341bf1a5b4, NAME => 'hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:49,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:49,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,070 INFO [StoreOpener-0161aa34cb75266f8e6e79341bf1a5b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,072 DEBUG [StoreOpener-0161aa34cb75266f8e6e79341bf1a5b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/info 2023-02-15 21:01:49,072 DEBUG [StoreOpener-0161aa34cb75266f8e6e79341bf1a5b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/info 2023-02-15 21:01:49,072 INFO [StoreOpener-0161aa34cb75266f8e6e79341bf1a5b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0161aa34cb75266f8e6e79341bf1a5b4 columnFamilyName info 2023-02-15 21:01:49,072 INFO [StoreOpener-0161aa34cb75266f8e6e79341bf1a5b4-1] regionserver.HStore(310): Store=0161aa34cb75266f8e6e79341bf1a5b4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:49,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:49,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:49,077 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0161aa34cb75266f8e6e79341bf1a5b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58778846, jitterRate=-0.12412694096565247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:49,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0161aa34cb75266f8e6e79341bf1a5b4: 2023-02-15 21:01:49,078 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4., pid=6, masterSystemTime=1676494909050 2023-02-15 21:01:49,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:49,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:49,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0161aa34cb75266f8e6e79341bf1a5b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:49,081 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494909081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494909081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494909081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494909081"}]},"ts":"1676494909081"} 2023-02-15 21:01:49,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:49,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0161aa34cb75266f8e6e79341bf1a5b4, server=jenkins-hbase4.apache.org,46729,1676494908139 in 183 msec 2023-02-15 21:01:49,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:49,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0161aa34cb75266f8e6e79341bf1a5b4, ASSIGN in 339 msec 2023-02-15 21:01:49,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:49,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494909085"}]},"ts":"1676494909085"} 2023-02-15 21:01:49,086 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:49,090 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:49,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 383 msec 2023-02-15 21:01:49,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:49,110 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:49,110 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:49,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:49,119 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:49,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-15 21:01:49,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:49,130 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:49,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-15 21:01:49,137 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:49,140 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:49,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.967sec 2023-02-15 21:01:49,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:49,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:49,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:49,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34587,1676494908066-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:49,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34587,1676494908066-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:49,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:49,165 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(139): Connect 0x7d4c50bc to 127.0.0.1:57917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:49,173 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3654b649, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:49,174 DEBUG [hconnection-0x1f4f0c10-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:49,176 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53446, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:49,177 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:49,177 DEBUG [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:49,179 DEBUG [Listener at localhost/35313] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:49,180 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:49,180 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:49,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:49892 deadline: 1676494969181, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,181 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-15 21:01:49,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:49,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,185 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:49,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-15 21:01:49,186 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:49,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:49,187 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,187 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 empty. 2023-02-15 21:01:49,188 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,188 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 21:01:49,195 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:49,197 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f591f505f882b34ba993945fb979884, NAME => 'testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp 2023-02-15 21:01:49,202 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:49,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 3f591f505f882b34ba993945fb979884, disabling compactions & flushes 2023-02-15 21:01:49,203 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. after waiting 0 ms 2023-02-15 21:01:49,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,203 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,203 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:49,204 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:49,205 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676494909205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494909205"}]},"ts":"1676494909205"} 2023-02-15 21:01:49,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:49,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:49,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494909207"}]},"ts":"1676494909207"} 2023-02-15 21:01:49,208 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-15 21:01:49,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:49,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:49,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:49,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:49,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, ASSIGN}] 2023-02-15 21:01:49,215 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, ASSIGN 2023-02-15 21:01:49,215 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33031,1676494908114; forceNewPlan=false, retain=false 2023-02-15 21:01:49,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:49,366 INFO [jenkins-hbase4:34587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:49,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3f591f505f882b34ba993945fb979884, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676494909366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494909366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494909366"}]},"ts":"1676494909366"} 2023-02-15 21:01:49,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 3f591f505f882b34ba993945fb979884, server=jenkins-hbase4.apache.org,33031,1676494908114}] 2023-02-15 21:01:49,447 INFO [RS:0;jenkins-hbase4:33031] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33031%2C1676494908114, suffix=, logDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,33031,1676494908114, archiveDir=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/oldWALs, maxLogs=32 2023-02-15 21:01:49,462 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK] 2023-02-15 21:01:49,462 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK] 2023-02-15 21:01:49,463 INFO [RS:0;jenkins-hbase4:33031] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,33031,1676494908114/jenkins-hbase4.apache.org%2C33031%2C1676494908114.1676494909448 2023-02-15 21:01:49,464 DEBUG [RS:0;jenkins-hbase4:33031] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44995,DS-5b6a8129-36b4-4cc4-a5c0-a728a3d603bc,DISK], DatanodeInfoWithStorage[127.0.0.1:35277,DS-a1d05784-73a1-4aed-a608-2d3e6f3790d4,DISK]] 2023-02-15 21:01:49,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:49,520 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,520 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:49,522 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:49,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f591f505f882b34ba993945fb979884, NAME => 'testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:49,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:49,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,525 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,526 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1 2023-02-15 21:01:49,527 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1 2023-02-15 21:01:49,527 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f591f505f882b34ba993945fb979884 columnFamilyName f1 2023-02-15 21:01:49,527 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(310): Store=3f591f505f882b34ba993945fb979884/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:49,527 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,528 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2 2023-02-15 21:01:49,528 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2 2023-02-15 21:01:49,528 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f591f505f882b34ba993945fb979884 columnFamilyName f2 2023-02-15 21:01:49,529 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(310): Store=3f591f505f882b34ba993945fb979884/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:49,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:49,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:49,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f591f505f882b34ba993945fb979884; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59356052, jitterRate=-0.11552590131759644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:49,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:49,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884., pid=12, masterSystemTime=1676494909520 2023-02-15 21:01:49,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,540 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3f591f505f882b34ba993945fb979884, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,540 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676494909540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494909540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494909540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494909540"}]},"ts":"1676494909540"} 2023-02-15 21:01:49,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 21:01:49,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 3f591f505f882b34ba993945fb979884, server=jenkins-hbase4.apache.org,33031,1676494908114 in 173 msec 2023-02-15 21:01:49,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 21:01:49,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, ASSIGN in 330 msec 2023-02-15 21:01:49,544 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:49,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494909544"}]},"ts":"1676494909544"} 2023-02-15 21:01:49,546 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-15 21:01:49,548 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:49,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 364 msec 2023-02-15 21:01:49,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:49,790 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-15 21:01:49,790 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-15 21:01:49,791 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:49,793 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-15 21:01:49,793 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:49,793 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-15 21:01:49,793 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:49,808 DEBUG [hconnection-0x1f4f0c10-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:49,826 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:49,834 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33031] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,917 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:49,917 INFO [Listener at localhost/35313] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:49,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 21:01:49,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494909918 (current time:1676494909918). 2023-02-15 21:01:49,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] zookeeper.ReadOnlyZKClient(139): Connect 0x3d8af0bd to 127.0.0.1:57917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:49,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b8ea77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:49,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:49,924 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53448, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:49,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d8af0bd to 127.0.0.1:57917 2023-02-15 21:01:49,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:49,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:49,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 21:01:49,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 21:01:49,928 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 21:01:49,929 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676495509929 2023-02-15 21:01:49,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-15 21:01:49,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,930 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:49,930 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:49,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 21:01:49,932 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-15 21:01:49,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-15 21:01:49,933 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 21:01:49,934 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676495509934 2023-02-15 21:01:49,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,945 INFO [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 21:01:49,945 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:49,946 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 21:01:49,946 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 21:01:49,947 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,947 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,948 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:49,948 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:49,948 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:49,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:49,949 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,949 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 21:01:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 21:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-15 21:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-15 21:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,950 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 21:01:49,950 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 21:01:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-15 21:01:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 21:01:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33031,1676494908114' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 21:01:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 21:01:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 21:01:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46729,1676494908139' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 21:01:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,953 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:49,954 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33031,1676494908114' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 21:01:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@767f5806[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:49,955 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 21:01:49,955 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,956 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,956 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,956 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:49,957 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:49,956 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 21:01:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 21:01:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46729,1676494908139' in zk 2023-02-15 21:01:49,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 21:01:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 21:01:49,957 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:49,957 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:49,957 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. started... 2023-02-15 21:01:49,957 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3f591f505f882b34ba993945fb979884 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 21:01:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 21:01:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 21:01:49,970 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f1/c9df1810205b48468b7cbaa592c54e65 2023-02-15 21:01:49,986 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f2/5e1ff3eb092f46afaa5cc1d866304664 2023-02-15 21:01:49,989 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f1/c9df1810205b48468b7cbaa592c54e65 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/c9df1810205b48468b7cbaa592c54e65 2023-02-15 21:01:49,992 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/c9df1810205b48468b7cbaa592c54e65, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:49,993 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f2/5e1ff3eb092f46afaa5cc1d866304664 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/5e1ff3eb092f46afaa5cc1d866304664 2023-02-15 21:01:49,996 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/5e1ff3eb092f46afaa5cc1d866304664, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:49,997 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 3f591f505f882b34ba993945fb979884 in 40ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:49,997 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-15 21:01:49,997 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:49,997 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,997 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:49,998 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/c9df1810205b48468b7cbaa592c54e65] hfiles 2023-02-15 21:01:49,998 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/c9df1810205b48468b7cbaa592c54e65 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:49,998 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/5e1ff3eb092f46afaa5cc1d866304664] hfiles 2023-02-15 21:01:49,998 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/5e1ff3eb092f46afaa5cc1d866304664 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,002 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. completed. 2023-02-15 21:01:50,003 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 21:01:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 21:01:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 21:01:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33031,1676494908114' in zk 2023-02-15 21:01:50,004 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 21:01:50,004 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,004 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:50,004 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 21:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33031,1676494908114': 2023-02-15 21:01:50,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33031,1676494908114' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:50,007 INFO [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 21:01:50,007 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:50,007 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:50,007 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,007 INFO [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:50,009 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:50,009 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:50,009 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:50,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:50,009 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,010 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,011 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:50,011 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,017 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:50,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,018 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:50,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:50,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,031 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:50,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 21:01:50,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:50,032 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:50,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-15 21:01:50,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,046 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676494909929Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676494910018 (+89 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676494910018Writing data manifest for testWithMockedMapReduceSingleRegion at 1676494910020 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676494910026 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676494910046 (+20 ms) 2023-02-15 21:01:50,048 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-15 21:01:50,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 118 msec 2023-02-15 21:01:50,232 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:50,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-15 21:01:50,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:50,233 INFO [Listener at localhost/35313] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:50,237 INFO [Listener at localhost/35313] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:50,242 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:50,269 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33031] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,365 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:50,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:50,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,372 INFO [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-15 21:01:50,372 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:50,373 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-15 21:01:50,373 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 21:01:50,373 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,373 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,375 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:50,375 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:50,375 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:50,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:50,375 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,375 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,377 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 21:01:50,377 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:50,377 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-15 21:01:50,377 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 21:01:50,377 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:50,378 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 21:01:50,378 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,378 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:50,378 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 21:01:50,378 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. started... 2023-02-15 21:01:50,378 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 21:01:50,378 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46729,1676494908139' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 21:01:50,378 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f591f505f882b34ba993945fb979884 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 21:01:50,380 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,380 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,380 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:50,399 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f1/6614bd2427df4d7e8ba9bd218920dfe9 2023-02-15 21:01:50,418 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f2/fd0d59e275c74f9d889c4996462598fb 2023-02-15 21:01:50,422 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f1/6614bd2427df4d7e8ba9bd218920dfe9 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/6614bd2427df4d7e8ba9bd218920dfe9 2023-02-15 21:01:50,426 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/6614bd2427df4d7e8ba9bd218920dfe9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:50,427 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/.tmp/f2/fd0d59e275c74f9d889c4996462598fb as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/fd0d59e275c74f9d889c4996462598fb 2023-02-15 21:01:50,432 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/fd0d59e275c74f9d889c4996462598fb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:50,433 INFO [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 3f591f505f882b34ba993945fb979884 in 55ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:50,434 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:50,434 DEBUG [rs(jenkins-hbase4.apache.org,33031,1676494908114)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,434 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 21:01:50,434 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 21:01:50,434 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,434 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-15 21:01:50,434 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33031,1676494908114' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-15 21:01:50,436 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,436 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:50,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:50,436 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,436 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:50,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:50,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33031,1676494908114' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-15 21:01:50,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7240d211[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:50,439 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 21:01:50,439 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,441 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 21:01:50,441 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,441 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:50,441 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 21:01:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33031,1676494908114' in zk 2023-02-15 21:01:50,441 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 21:01:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-15 21:01:50,442 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46729,1676494908139' in zk 2023-02-15 21:01:50,443 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,443 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 21:01:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:50,443 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:50,443 DEBUG [member: 'jenkins-hbase4.apache.org,33031,1676494908114' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 21:01:50,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:50,443 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-15 21:01:50,444 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:50,444 DEBUG [member: 'jenkins-hbase4.apache.org,46729,1676494908139' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-15 21:01:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33031,1676494908114': 2023-02-15 21:01:50,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33031,1676494908114' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:50,446 INFO [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-15 21:01:50,446 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:50,446 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:50,446 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,446 INFO [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:50,448 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:50,448 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:50,448 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:50,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:50,448 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:50,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,449 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,450 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:50,451 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:50,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-15 21:01:50,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:01:50,454 DEBUG [(jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:50,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:50,455 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:01:50,454 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,455 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:50,555 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:01:50,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:01:50,560 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676494909918 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:50,560 DEBUG [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde/data/default/testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,560 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,560 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=3f591f505f882b34ba993945fb979884 as 3f591f505f882b34ba993945fb979884 in snapshot testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,561 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f591f505f882b34ba993945fb979884, NAME => 'testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde 2023-02-15 21:01:50,567 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:50,567 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9df1810205b48468b7cbaa592c54e65 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,569 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5e1ff3eb092f46afaa5cc1d866304664 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3f591f505f882b34ba993945fb979884, disabling compactions & flushes 2023-02-15 21:01:50,570 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. after waiting 0 ms 2023-02-15 21:01:50,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,570 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,571 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:50,571 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676494909918 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:50,571 DEBUG [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde 2023-02-15 21:01:50,571 DEBUG [Listener at localhost/35313] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde 2023-02-15 21:01:50,571 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-data/ 2023-02-15 21:01:50,572 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----default/ 2023-02-15 21:01:50,572 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-15 21:01:50,572 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------3f591f505f882b34ba993945fb979884/ 2023-02-15 21:01:50,573 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:50,573 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:50,573 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=3f591f505f882b34ba993945fb979884-c9df1810205b48468b7cbaa592c54e65 2023-02-15 21:01:50,573 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:50,574 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=3f591f505f882b34ba993945fb979884-5e1ff3eb092f46afaa5cc1d866304664 2023-02-15 21:01:50,577 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 21:01:50,581 DEBUG [Listener at localhost/35313] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:50,581 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:01:50,586 DEBUG [Listener at localhost/35313] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:50,589 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,590 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1 2023-02-15 21:01:50,590 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f591f505f882b34ba993945fb979884 columnFamilyName f1 2023-02-15 21:01:50,594 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(539): loaded hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/testWithMockedMapReduceSingleRegion=3f591f505f882b34ba993945fb979884-c9df1810205b48468b7cbaa592c54e65 2023-02-15 21:01:50,594 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(310): Store=3f591f505f882b34ba993945fb979884/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:50,594 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,595 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2 2023-02-15 21:01:50,595 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f591f505f882b34ba993945fb979884 columnFamilyName f2 2023-02-15 21:01:50,598 DEBUG [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(539): loaded hdfs://localhost:45265/user/jenkins/test-data/fcf70f6b-ec6f-7aa5-34e4-2319e032aabc/testWithMockedMapReduceSingleRegion/b796eacb-cf79-4c88-83a6-96f5f7a60fde/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/testWithMockedMapReduceSingleRegion=3f591f505f882b34ba993945fb979884-5e1ff3eb092f46afaa5cc1d866304664 2023-02-15 21:01:50,598 INFO [StoreOpener-3f591f505f882b34ba993945fb979884-1] regionserver.HStore(310): Store=3f591f505f882b34ba993945fb979884/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:50,598 DEBUG [Listener at localhost/35313] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:50,598 INFO [Listener at localhost/35313] regionserver.HRegion(1071): Opened 3f591f505f882b34ba993945fb979884; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75296105, jitterRate=0.12199939787387848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:50,598 DEBUG [Listener at localhost/35313] regionserver.HRegion(964): Region open journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:50,645 DEBUG [Listener at localhost/35313] regionserver.HRegion(1603): Closing 3f591f505f882b34ba993945fb979884, disabling compactions & flushes 2023-02-15 21:01:50,645 INFO [Listener at localhost/35313] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,645 DEBUG [Listener at localhost/35313] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,645 DEBUG [Listener at localhost/35313] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. after waiting 0 ms 2023-02-15 21:01:50,645 DEBUG [Listener at localhost/35313] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,646 INFO [Listener at localhost/35313] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,646 DEBUG [Listener at localhost/35313] regionserver.HRegion(1557): Region close journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:50,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-15 21:01:50,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,653 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:50,658 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494910658"}]},"ts":"1676494910658"} 2023-02-15 21:01:50,659 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-15 21:01:50,661 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-15 21:01:50,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, UNASSIGN}] 2023-02-15 21:01:50,663 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, UNASSIGN 2023-02-15 21:01:50,663 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3f591f505f882b34ba993945fb979884, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:50,663 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676494910663"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494910663"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494910663"}]},"ts":"1676494910663"} 2023-02-15 21:01:50,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 3f591f505f882b34ba993945fb979884, server=jenkins-hbase4.apache.org,33031,1676494908114}] 2023-02-15 21:01:50,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:50,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f591f505f882b34ba993945fb979884, disabling compactions & flushes 2023-02-15 21:01:50,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. after waiting 0 ms 2023-02-15 21:01:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:50,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884. 2023-02-15 21:01:50,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f591f505f882b34ba993945fb979884: 2023-02-15 21:01:50,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,823 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3f591f505f882b34ba993945fb979884, regionState=CLOSED 2023-02-15 21:01:50,823 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676494910823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494910823"}]},"ts":"1676494910823"} 2023-02-15 21:01:50,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 21:01:50,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 3f591f505f882b34ba993945fb979884, server=jenkins-hbase4.apache.org,33031,1676494908114 in 159 msec 2023-02-15 21:01:50,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 21:01:50,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=3f591f505f882b34ba993945fb979884, UNASSIGN in 165 msec 2023-02-15 21:01:50,828 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494910828"}]},"ts":"1676494910828"} 2023-02-15 21:01:50,829 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-15 21:01:50,830 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-15 21:01:50,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-15 21:01:50,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:50,961 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-15 21:01:50,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,964 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,965 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:01:50,967 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,969 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1, FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2, FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/recovered.edits] 2023-02-15 21:01:50,972 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/6614bd2427df4d7e8ba9bd218920dfe9 to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/archive/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/6614bd2427df4d7e8ba9bd218920dfe9 2023-02-15 21:01:50,973 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/c9df1810205b48468b7cbaa592c54e65 to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/archive/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f1/c9df1810205b48468b7cbaa592c54e65 2023-02-15 21:01:50,975 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/5e1ff3eb092f46afaa5cc1d866304664 to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/archive/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/5e1ff3eb092f46afaa5cc1d866304664 2023-02-15 21:01:50,976 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/fd0d59e275c74f9d889c4996462598fb to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/archive/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/f2/fd0d59e275c74f9d889c4996462598fb 2023-02-15 21:01:50,978 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/recovered.edits/12.seqid to hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/archive/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884/recovered.edits/12.seqid 2023-02-15 21:01:50,978 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/.tmp/data/default/testWithMockedMapReduceSingleRegion/3f591f505f882b34ba993945fb979884 2023-02-15 21:01:50,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-15 21:01:50,980 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,982 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-15 21:01:50,983 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-15 21:01:50,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-15 21:01:50,984 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494910984"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:50,985 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 21:01:50,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f591f505f882b34ba993945fb979884, NAME => 'testWithMockedMapReduceSingleRegion,,1676494909183.3f591f505f882b34ba993945fb979884.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 21:01:50,985 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-15 21:01:50,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676494910985"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:50,986 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-15 21:01:50,988 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-15 21:01:50,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-15 21:01:51,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34587] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:01:51,067 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-15 21:01:51,067 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:01:51,067 INFO [Listener at localhost/35313] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:01:51,067 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d4c50bc to 127.0.0.1:57917 2023-02-15 21:01:51,067 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,067 DEBUG [Listener at localhost/35313] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:01:51,067 DEBUG [Listener at localhost/35313] util.JVMClusterUtil(257): Found active master hash=1855123238, stopped=false 2023-02-15 21:01:51,067 INFO [Listener at localhost/35313] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:51,070 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:51,070 INFO [Listener at localhost/35313] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:01:51,070 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:51,070 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:51,070 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:51,072 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18b08e62 to 127.0.0.1:57917 2023-02-15 21:01:51,072 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:51,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:51,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:51,072 INFO [Listener at localhost/35313] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33031,1676494908114' ***** 2023-02-15 21:01:51,072 INFO [Listener at localhost/35313] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:51,073 INFO [Listener at localhost/35313] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46729,1676494908139' ***** 2023-02-15 21:01:51,073 INFO [Listener at localhost/35313] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:51,073 INFO [RS:0;jenkins-hbase4:33031] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:51,073 INFO [RS:1;jenkins-hbase4:46729] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:51,073 INFO [RS:0;jenkins-hbase4:33031] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:51,073 INFO [RS:1;jenkins-hbase4:46729] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:51,073 INFO [RS:0;jenkins-hbase4:33031] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:51,073 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:51,073 DEBUG [RS:0;jenkins-hbase4:33031] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0355e194 to 127.0.0.1:57917 2023-02-15 21:01:51,073 DEBUG [RS:0;jenkins-hbase4:33031] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,073 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33031,1676494908114; all regions closed. 2023-02-15 21:01:51,073 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:51,073 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:51,073 INFO [RS:1;jenkins-hbase4:46729] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:51,075 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(3304): Received CLOSE for 0161aa34cb75266f8e6e79341bf1a5b4 2023-02-15 21:01:51,078 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:51,078 DEBUG [RS:1;jenkins-hbase4:46729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54b58bd2 to 127.0.0.1:57917 2023-02-15 21:01:51,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0161aa34cb75266f8e6e79341bf1a5b4, disabling compactions & flushes 2023-02-15 21:01:51,078 DEBUG [RS:1;jenkins-hbase4:46729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:51,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:51,078 INFO [RS:1;jenkins-hbase4:46729] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:51,078 INFO [RS:1;jenkins-hbase4:46729] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:51,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. after waiting 0 ms 2023-02-15 21:01:51,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:51,078 INFO [RS:1;jenkins-hbase4:46729] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:51,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 0161aa34cb75266f8e6e79341bf1a5b4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:01:51,078 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:01:51,078 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 21:01:51,078 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 0161aa34cb75266f8e6e79341bf1a5b4=hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4.} 2023-02-15 21:01:51,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:51,078 DEBUG [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1505): Waiting on 0161aa34cb75266f8e6e79341bf1a5b4, 1588230740 2023-02-15 21:01:51,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:51,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:51,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:51,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:51,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-15 21:01:51,081 DEBUG [RS:0;jenkins-hbase4:33031] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/oldWALs 2023-02-15 21:01:51,081 INFO [RS:0;jenkins-hbase4:33031] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33031%2C1676494908114:(num 1676494909448) 2023-02-15 21:01:51,081 DEBUG [RS:0;jenkins-hbase4:33031] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,081 INFO [RS:0;jenkins-hbase4:33031] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:51,081 INFO [RS:0;jenkins-hbase4:33031] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:51,081 INFO [RS:0;jenkins-hbase4:33031] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:51,081 INFO [RS:0;jenkins-hbase4:33031] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:51,081 INFO [RS:0;jenkins-hbase4:33031] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:51,081 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:51,082 INFO [RS:0;jenkins-hbase4:33031] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33031 2023-02-15 21:01:51,085 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:51,085 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:51,085 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:51,085 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33031,1676494908114] 2023-02-15 21:01:51,085 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33031,1676494908114; numProcessing=1 2023-02-15 21:01:51,086 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33031,1676494908114 2023-02-15 21:01:51,086 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33031,1676494908114 already deleted, retry=false 2023-02-15 21:01:51,086 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33031,1676494908114 expired; onlineServers=1 2023-02-15 21:01:51,086 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22e2cd8c rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,086 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:51,086 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@664cbb42 rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/.tmp/info/8cac6adb8ee846dda3cab02ff3aa5226 2023-02-15 21:01:51,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/.tmp/info/d13a6161d844432b97bae1b9591285de 2023-02-15 21:01:51,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/.tmp/info/8cac6adb8ee846dda3cab02ff3aa5226 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/info/8cac6adb8ee846dda3cab02ff3aa5226 2023-02-15 21:01:51,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d13a6161d844432b97bae1b9591285de 2023-02-15 21:01:51,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/info/8cac6adb8ee846dda3cab02ff3aa5226, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:01:51,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0161aa34cb75266f8e6e79341bf1a5b4 in 20ms, sequenceid=6, compaction requested=false 2023-02-15 21:01:51,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/namespace/0161aa34cb75266f8e6e79341bf1a5b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:01:51,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:51,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0161aa34cb75266f8e6e79341bf1a5b4: 2023-02-15 21:01:51,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494908707.0161aa34cb75266f8e6e79341bf1a5b4. 2023-02-15 21:01:51,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/.tmp/rep_barrier/87ce5930ec6c4d1a89a95fac3f335be3 2023-02-15 21:01:51,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87ce5930ec6c4d1a89a95fac3f335be3 2023-02-15 21:01:51,107 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:51,107 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-15 21:01:51,113 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/.tmp/table/9f2776566b1746d4a2075f00ec6b1f02 2023-02-15 21:01:51,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f2776566b1746d4a2075f00ec6b1f02 2023-02-15 21:01:51,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/.tmp/info/d13a6161d844432b97bae1b9591285de as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/info/d13a6161d844432b97bae1b9591285de 2023-02-15 21:01:51,120 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:51,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d13a6161d844432b97bae1b9591285de 2023-02-15 21:01:51,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/info/d13a6161d844432b97bae1b9591285de, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 21:01:51,122 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/.tmp/rep_barrier/87ce5930ec6c4d1a89a95fac3f335be3 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/rep_barrier/87ce5930ec6c4d1a89a95fac3f335be3 2023-02-15 21:01:51,123 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:51,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87ce5930ec6c4d1a89a95fac3f335be3 2023-02-15 21:01:51,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/rep_barrier/87ce5930ec6c4d1a89a95fac3f335be3, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 21:01:51,127 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/.tmp/table/9f2776566b1746d4a2075f00ec6b1f02 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/table/9f2776566b1746d4a2075f00ec6b1f02 2023-02-15 21:01:51,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9f2776566b1746d4a2075f00ec6b1f02 2023-02-15 21:01:51,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/table/9f2776566b1746d4a2075f00ec6b1f02, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 21:01:51,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false 2023-02-15 21:01:51,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 21:01:51,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:51,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:51,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:51,138 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:51,270 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:51,270 INFO [RS:0;jenkins-hbase4:33031] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33031,1676494908114; zookeeper connection closed. 2023-02-15 21:01:51,270 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e0fa6f1 rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,270 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:33031-0x10059ca14540001, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:51,270 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e5056f rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,270 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@173a073] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@173a073 2023-02-15 21:01:51,279 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46729,1676494908139; all regions closed. 2023-02-15 21:01:51,282 DEBUG [RS:1;jenkins-hbase4:46729] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/oldWALs 2023-02-15 21:01:51,282 INFO [RS:1;jenkins-hbase4:46729] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46729%2C1676494908139.meta:.meta(num 1676494908659) 2023-02-15 21:01:51,284 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/WALs/jenkins-hbase4.apache.org,46729,1676494908139/jenkins-hbase4.apache.org%2C46729%2C1676494908139.1676494909055 not finished, retry = 0 2023-02-15 21:01:51,387 DEBUG [RS:1;jenkins-hbase4:46729] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/oldWALs 2023-02-15 21:01:51,387 INFO [RS:1;jenkins-hbase4:46729] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46729%2C1676494908139:(num 1676494909055) 2023-02-15 21:01:51,387 DEBUG [RS:1;jenkins-hbase4:46729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,387 INFO [RS:1;jenkins-hbase4:46729] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:51,387 INFO [RS:1;jenkins-hbase4:46729] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:51,387 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:51,389 INFO [RS:1;jenkins-hbase4:46729] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46729 2023-02-15 21:01:51,391 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46729,1676494908139 2023-02-15 21:01:51,391 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:51,391 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@100556d3 rejected from java.util.concurrent.ThreadPoolExecutor@143ad00b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,395 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46729,1676494908139] 2023-02-15 21:01:51,395 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46729,1676494908139; numProcessing=2 2023-02-15 21:01:51,396 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46729,1676494908139 already deleted, retry=false 2023-02-15 21:01:51,396 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46729,1676494908139 expired; onlineServers=0 2023-02-15 21:01:51,396 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34587,1676494908066' ***** 2023-02-15 21:01:51,396 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:01:51,397 DEBUG [M:0;jenkins-hbase4:34587] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aad762c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:51,397 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34587,1676494908066 2023-02-15 21:01:51,397 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34587,1676494908066; all regions closed. 2023-02-15 21:01:51,397 DEBUG [M:0;jenkins-hbase4:34587] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:51,397 DEBUG [M:0;jenkins-hbase4:34587] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:01:51,397 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:01:51,397 DEBUG [M:0;jenkins-hbase4:34587] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:01:51,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494908304] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494908304,5,FailOnTimeoutGroup] 2023-02-15 21:01:51,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494908301] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494908301,5,FailOnTimeoutGroup] 2023-02-15 21:01:51,397 INFO [M:0;jenkins-hbase4:34587] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:01:51,398 INFO [M:0;jenkins-hbase4:34587] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:01:51,398 INFO [M:0;jenkins-hbase4:34587] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:01:51,398 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:51,398 DEBUG [M:0;jenkins-hbase4:34587] master.HMaster(1512): Stopping service threads 2023-02-15 21:01:51,398 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:51,398 INFO [M:0;jenkins-hbase4:34587] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:01:51,399 ERROR [M:0;jenkins-hbase4:34587] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 21:01:51,399 INFO [M:0;jenkins-hbase4:34587] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:01:51,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:51,399 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:01:51,399 DEBUG [M:0;jenkins-hbase4:34587] zookeeper.ZKUtil(398): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:01:51,399 WARN [M:0;jenkins-hbase4:34587] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:01:51,400 INFO [M:0;jenkins-hbase4:34587] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:01:51,400 INFO [M:0;jenkins-hbase4:34587] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:01:51,400 DEBUG [M:0;jenkins-hbase4:34587] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:51,400 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:51,400 DEBUG [M:0;jenkins-hbase4:34587] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:51,400 DEBUG [M:0;jenkins-hbase4:34587] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:51,400 DEBUG [M:0;jenkins-hbase4:34587] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:51,400 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.11 KB heapSize=67.06 KB 2023-02-15 21:01:51,410 INFO [M:0;jenkins-hbase4:34587] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.11 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7b91475b79d419688e04f2bbd709b28 2023-02-15 21:01:51,414 DEBUG [M:0;jenkins-hbase4:34587] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7b91475b79d419688e04f2bbd709b28 as hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7b91475b79d419688e04f2bbd709b28 2023-02-15 21:01:51,417 INFO [M:0;jenkins-hbase4:34587] regionserver.HStore(1080): Added hdfs://localhost:45265/user/jenkins/test-data/3f228675-0853-d52e-196a-fca9e6ae7dc4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7b91475b79d419688e04f2bbd709b28, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 21:01:51,418 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegion(2947): Finished flush of dataSize ~56.11 KB/57454, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-15 21:01:51,418 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:51,418 DEBUG [M:0;jenkins-hbase4:34587] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:51,420 INFO [M:0;jenkins-hbase4:34587] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:01:51,420 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:51,421 INFO [M:0;jenkins-hbase4:34587] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34587 2023-02-15 21:01:51,424 DEBUG [M:0;jenkins-hbase4:34587] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34587,1676494908066 already deleted, retry=false 2023-02-15 21:01:51,673 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:51,673 INFO [M:0;jenkins-hbase4:34587] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34587,1676494908066; zookeeper connection closed. 2023-02-15 21:01:51,673 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@39207670 rejected from java.util.concurrent.ThreadPoolExecutor@3d1ff58c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,674 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:34587-0x10059ca14540000, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:51,674 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73861dca rejected from java.util.concurrent.ThreadPoolExecutor@3d1ff58c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,773 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:51,773 INFO [RS:1;jenkins-hbase4:46729] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46729,1676494908139; zookeeper connection closed. 2023-02-15 21:01:51,773 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5aaa2cd7 rejected from java.util.concurrent.ThreadPoolExecutor@143ad00b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,773 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:46729-0x10059ca14540002, quorum=127.0.0.1:57917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:51,773 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@225b6418 rejected from java.util.concurrent.ThreadPoolExecutor@143ad00b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:51,773 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4cc35df] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4cc35df 2023-02-15 21:01:51,774 INFO [Listener at localhost/35313] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:01:51,775 WARN [Listener at localhost/35313] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:51,778 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:51,883 WARN [BP-504037618-172.31.14.131-1676494907442 heartbeating to localhost/127.0.0.1:45265] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:51,883 WARN [BP-504037618-172.31.14.131-1676494907442 heartbeating to localhost/127.0.0.1:45265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-504037618-172.31.14.131-1676494907442 (Datanode Uuid e6549a5c-d6db-4c79-8d02-186e999faa20) service to localhost/127.0.0.1:45265 2023-02-15 21:01:51,884 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/dfs/data/data3/current/BP-504037618-172.31.14.131-1676494907442] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:51,884 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/dfs/data/data4/current/BP-504037618-172.31.14.131-1676494907442] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:51,885 WARN [Listener at localhost/35313] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:51,888 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:51,993 WARN [BP-504037618-172.31.14.131-1676494907442 heartbeating to localhost/127.0.0.1:45265] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:51,993 WARN [BP-504037618-172.31.14.131-1676494907442 heartbeating to localhost/127.0.0.1:45265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-504037618-172.31.14.131-1676494907442 (Datanode Uuid 59fb5855-5d2b-4889-bd2d-23610aa0d982) service to localhost/127.0.0.1:45265 2023-02-15 21:01:51,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/dfs/data/data1/current/BP-504037618-172.31.14.131-1676494907442] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:51,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/cluster_3df98183-0a38-3d13-7796-106dfebbf532/dfs/data/data2/current/BP-504037618-172.31.14.131-1676494907442] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:52,005 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:52,122 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:01:52,140 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:01:52,152 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=256 (was 231) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:45265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35313 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34587,1676494908066)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35313.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45265 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45265 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:45265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=655 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 291), ProcessCount=166 (was 166), AvailableMemoryMB=2704 (was 2744) 2023-02-15 21:01:52,162 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=256, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=166, AvailableMemoryMB=2703 2023-02-15 21:01:52,172 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/hadoop.log.dir so I do NOT create it in target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969 2023-02-15 21:01:52,173 WARN [Listener at localhost/35313] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/hadoop.tmp.dir so I do NOT create it in target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969 2023-02-15 21:01:52,173 WARN [Listener at localhost/35313] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/78f35245-2d6f-0336-ffe5-030b983dbc70/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 21:01:52,173 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70, deleteOnExit=true 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/test.cache.data in system properties and HBase conf 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:52,173 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:52,174 DEBUG [Listener at localhost/35313] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:52,174 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:52,175 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:52,175 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:52,175 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:52,175 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:52,175 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:52,179 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:52,179 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:52,218 WARN [Listener at localhost/35313] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:52,219 INFO [Listener at localhost/35313] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:52,224 INFO [Listener at localhost/35313] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/java.io.tmpdir/Jetty_localhost_35103_hdfs____bptmgs/webapp 2023-02-15 21:01:52,315 INFO [Listener at localhost/35313] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35103 2023-02-15 21:01:52,319 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:52,319 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:52,371 WARN [Listener at localhost/41347] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:52,386 WARN [Listener at localhost/41347] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:52,388 WARN [Listener at localhost/41347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:52,389 INFO [Listener at localhost/41347] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:52,393 INFO [Listener at localhost/41347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/java.io.tmpdir/Jetty_localhost_36867_datanode____.flvkgz/webapp 2023-02-15 21:01:52,485 INFO [Listener at localhost/41347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36867 2023-02-15 21:01:52,499 WARN [Listener at localhost/41387] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:52,514 WARN [Listener at localhost/41387] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:52,517 WARN [Listener at localhost/41387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:52,518 INFO [Listener at localhost/41387] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:52,521 INFO [Listener at localhost/41387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/java.io.tmpdir/Jetty_localhost_36779_datanode____cfb94t/webapp 2023-02-15 21:01:52,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b0cf1a2e096e0a2: Processing first storage report for DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a from datanode 75620640-c0bf-4197-ade5-68d8f749c8a2 2023-02-15 21:01:52,593 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b0cf1a2e096e0a2: from storage DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a node DatanodeRegistration(127.0.0.1:43085, datanodeUuid=75620640-c0bf-4197-ade5-68d8f749c8a2, infoPort=38499, infoSecurePort=0, ipcPort=41387, storageInfo=lv=-57;cid=testClusterID;nsid=150348554;c=1676494912182), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:52,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b0cf1a2e096e0a2: Processing first storage report for DS-d4e4d766-ba0a-45eb-908d-44a8fc22c8b2 from datanode 75620640-c0bf-4197-ade5-68d8f749c8a2 2023-02-15 21:01:52,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b0cf1a2e096e0a2: from storage DS-d4e4d766-ba0a-45eb-908d-44a8fc22c8b2 node DatanodeRegistration(127.0.0.1:43085, datanodeUuid=75620640-c0bf-4197-ade5-68d8f749c8a2, infoPort=38499, infoSecurePort=0, ipcPort=41387, storageInfo=lv=-57;cid=testClusterID;nsid=150348554;c=1676494912182), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:52,622 INFO [Listener at localhost/41387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36779 2023-02-15 21:01:52,629 WARN [Listener at localhost/36693] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:52,773 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x868634d835f0803d: Processing first storage report for DS-61341075-3a58-4e25-9ae3-956b6725e730 from datanode 261559dc-dd81-430e-bc23-90511c945d13 2023-02-15 21:01:52,773 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x868634d835f0803d: from storage DS-61341075-3a58-4e25-9ae3-956b6725e730 node DatanodeRegistration(127.0.0.1:46641, datanodeUuid=261559dc-dd81-430e-bc23-90511c945d13, infoPort=41959, infoSecurePort=0, ipcPort=36693, storageInfo=lv=-57;cid=testClusterID;nsid=150348554;c=1676494912182), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 21:01:52,773 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x868634d835f0803d: Processing first storage report for DS-a49c80f2-b1ce-4bbf-801a-996816f81fba from datanode 261559dc-dd81-430e-bc23-90511c945d13 2023-02-15 21:01:52,773 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x868634d835f0803d: from storage DS-a49c80f2-b1ce-4bbf-801a-996816f81fba node DatanodeRegistration(127.0.0.1:46641, datanodeUuid=261559dc-dd81-430e-bc23-90511c945d13, infoPort=41959, infoSecurePort=0, ipcPort=36693, storageInfo=lv=-57;cid=testClusterID;nsid=150348554;c=1676494912182), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:52,839 DEBUG [Listener at localhost/36693] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969 2023-02-15 21:01:52,841 INFO [Listener at localhost/36693] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/zookeeper_0, clientPort=52554, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:52,842 INFO [Listener at localhost/36693] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52554 2023-02-15 21:01:52,842 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,843 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,856 INFO [Listener at localhost/36693] util.FSUtils(479): Created version file at hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00 with version=8 2023-02-15 21:01:52,856 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,857 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,858 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41347/user/jenkins/test-data/c6469ede-49b5-f1bc-baa0-bcef5e9affd4/hbase-staging 2023-02-15 21:01:52,859 INFO [Listener at localhost/36693] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:52,859 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,860 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,860 INFO [Listener at localhost/36693] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:52,860 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,860 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:52,860 INFO [Listener at localhost/36693] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:52,862 INFO [Listener at localhost/36693] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40313 2023-02-15 21:01:52,862 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,863 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,864 INFO [Listener at localhost/36693] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40313 connecting to ZooKeeper ensemble=127.0.0.1:52554 2023-02-15 21:01:52,870 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:403130x0, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:52,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40313-0x10059ca270e0000 connected 2023-02-15 21:01:52,893 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:52,893 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:52,893 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:52,894 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40313 2023-02-15 21:01:52,894 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40313 2023-02-15 21:01:52,899 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40313 2023-02-15 21:01:52,899 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40313 2023-02-15 21:01:52,900 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40313 2023-02-15 21:01:52,900 INFO [Listener at localhost/36693] master.HMaster(444): hbase.rootdir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00, hbase.cluster.distributed=false 2023-02-15 21:01:52,912 INFO [Listener at localhost/36693] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:52,913 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,913 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,913 INFO [Listener at localhost/36693] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:52,913 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,913 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:52,913 INFO [Listener at localhost/36693] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:52,916 INFO [Listener at localhost/36693] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38465 2023-02-15 21:01:52,916 INFO [Listener at localhost/36693] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:52,917 DEBUG [Listener at localhost/36693] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:52,917 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,918 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,919 INFO [Listener at localhost/36693] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38465 connecting to ZooKeeper ensemble=127.0.0.1:52554 2023-02-15 21:01:52,921 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:384650x0, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:52,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38465-0x10059ca270e0001 connected 2023-02-15 21:01:52,922 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:52,922 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:52,923 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:52,924 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38465 2023-02-15 21:01:52,924 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38465 2023-02-15 21:01:52,924 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38465 2023-02-15 21:01:52,926 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38465 2023-02-15 21:01:52,926 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38465 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:52,936 INFO [Listener at localhost/36693] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:52,937 INFO [Listener at localhost/36693] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36669 2023-02-15 21:01:52,937 INFO [Listener at localhost/36693] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:52,938 DEBUG [Listener at localhost/36693] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:52,938 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,939 INFO [Listener at localhost/36693] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,940 INFO [Listener at localhost/36693] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36669 connecting to ZooKeeper ensemble=127.0.0.1:52554 2023-02-15 21:01:52,943 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:366690x0, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:52,943 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): regionserver:366690x0, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:52,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36669-0x10059ca270e0002 connected 2023-02-15 21:01:52,944 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:52,944 DEBUG [Listener at localhost/36693] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:52,948 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36669 2023-02-15 21:01:52,948 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36669 2023-02-15 21:01:52,948 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36669 2023-02-15 21:01:52,949 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36669 2023-02-15 21:01:52,949 DEBUG [Listener at localhost/36693] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36669 2023-02-15 21:01:52,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:52,954 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:52,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:52,956 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:52,956 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:52,956 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:52,956 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:52,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:52,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40313,1676494912859 from backup master directory 2023-02-15 21:01:52,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:52,961 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:52,961 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:52,961 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:52,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:52,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/hbase.id with ID: 8549cfcc-e4c0-4f26-baef-b5f26bc6ad66 2023-02-15 21:01:52,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:52,984 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:52,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x742c4d19 to 127.0.0.1:52554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:52,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c7d8001, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:52,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:52,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:52,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:53,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store-tmp 2023-02-15 21:01:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:53,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:53,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:53,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:53,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/WALs/jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:53,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40313%2C1676494912859, suffix=, logDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/WALs/jenkins-hbase4.apache.org,40313,1676494912859, archiveDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:53,019 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK] 2023-02-15 21:01:53,019 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK] 2023-02-15 21:01:53,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/WALs/jenkins-hbase4.apache.org,40313,1676494912859/jenkins-hbase4.apache.org%2C40313%2C1676494912859.1676494913007 2023-02-15 21:01:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK], DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK]] 2023-02-15 21:01:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:53,022 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:53,023 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:53,024 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:53,024 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:53,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:53,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:53,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:53,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62306600, jitterRate=-0.07155930995941162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:53,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:53,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:53,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:53,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:53,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:53,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 21:01:53,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 21:01:53,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:53,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:53,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:53,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:53,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:53,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:53,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:53,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:53,043 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:53,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:53,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:53,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:53,046 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:53,046 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:53,046 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:53,046 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:53,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40313,1676494912859, sessionid=0x10059ca270e0000, setting cluster-up flag (Was=false) 2023-02-15 21:01:53,052 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:53,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:53,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:53,058 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:53,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:53,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:53,063 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.hbase-snapshot/.tmp 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:53,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494943068 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,069 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:53,069 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:53,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494913070,5,FailOnTimeoutGroup] 2023-02-15 21:01:53,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494913070,5,FailOnTimeoutGroup] 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,070 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:53,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:53,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,080 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:53,080 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:53,080 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00 2023-02-15 21:01:53,087 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:53,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/info 2023-02-15 21:01:53,089 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:53,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:53,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:53,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:53,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:53,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/table 2023-02-15 21:01:53,092 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:53,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,093 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740 2023-02-15 21:01:53,093 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740 2023-02-15 21:01:53,095 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:53,095 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:53,097 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:53,097 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71327695, jitterRate=0.0628654807806015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:53,097 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:53,097 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:53,097 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:53,097 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:53,097 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:53,097 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:53,098 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:53,098 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:53,098 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:53,098 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:53,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:53,100 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:53,101 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:53,153 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(952): ClusterId : 8549cfcc-e4c0-4f26-baef-b5f26bc6ad66 2023-02-15 21:01:53,153 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(952): ClusterId : 8549cfcc-e4c0-4f26-baef-b5f26bc6ad66 2023-02-15 21:01:53,153 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:53,153 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:53,155 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:53,155 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:53,155 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:53,155 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:53,158 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:53,159 DEBUG [RS:1;jenkins-hbase4:36669] zookeeper.ReadOnlyZKClient(139): Connect 0x1b2413e7 to 127.0.0.1:52554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:53,159 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:53,160 DEBUG [RS:0;jenkins-hbase4:38465] zookeeper.ReadOnlyZKClient(139): Connect 0x5349002d to 127.0.0.1:52554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:53,164 DEBUG [RS:1;jenkins-hbase4:36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15e3eef3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:53,164 DEBUG [RS:0;jenkins-hbase4:38465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d8ee434, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:53,164 DEBUG [RS:1;jenkins-hbase4:36669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11dc7897, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:53,165 DEBUG [RS:0;jenkins-hbase4:38465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b16b5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:53,173 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38465 2023-02-15 21:01:53,173 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36669 2023-02-15 21:01:53,173 INFO [RS:0;jenkins-hbase4:38465] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:53,173 INFO [RS:1;jenkins-hbase4:36669] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:53,173 INFO [RS:1;jenkins-hbase4:36669] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:53,173 INFO [RS:0;jenkins-hbase4:38465] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:53,173 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:53,173 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:53,174 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40313,1676494912859 with isa=jenkins-hbase4.apache.org/172.31.14.131:38465, startcode=1676494912912 2023-02-15 21:01:53,174 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40313,1676494912859 with isa=jenkins-hbase4.apache.org/172.31.14.131:36669, startcode=1676494912936 2023-02-15 21:01:53,174 DEBUG [RS:0;jenkins-hbase4:38465] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:53,174 DEBUG [RS:1;jenkins-hbase4:36669] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:53,175 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40429, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:53,176 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58391, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:53,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40313] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,178 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00 2023-02-15 21:01:53,178 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41347 2023-02-15 21:01:53,178 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00 2023-02-15 21:01:53,178 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:53,178 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41347 2023-02-15 21:01:53,178 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:53,179 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:53,184 DEBUG [RS:0;jenkins-hbase4:38465] zookeeper.ZKUtil(162): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,184 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38465,1676494912912] 2023-02-15 21:01:53,184 WARN [RS:0;jenkins-hbase4:38465] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:53,184 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36669,1676494912936] 2023-02-15 21:01:53,184 DEBUG [RS:1;jenkins-hbase4:36669] zookeeper.ZKUtil(162): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,184 INFO [RS:0;jenkins-hbase4:38465] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:53,184 WARN [RS:1;jenkins-hbase4:36669] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:53,184 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,184 INFO [RS:1;jenkins-hbase4:36669] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:53,184 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,188 DEBUG [RS:1;jenkins-hbase4:36669] zookeeper.ZKUtil(162): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,188 DEBUG [RS:0;jenkins-hbase4:38465] zookeeper.ZKUtil(162): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,188 DEBUG [RS:1;jenkins-hbase4:36669] zookeeper.ZKUtil(162): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,188 DEBUG [RS:0;jenkins-hbase4:38465] zookeeper.ZKUtil(162): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,189 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:53,189 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:53,189 INFO [RS:1;jenkins-hbase4:36669] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:53,189 INFO [RS:0;jenkins-hbase4:38465] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:53,190 INFO [RS:1;jenkins-hbase4:36669] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:53,190 INFO [RS:1;jenkins-hbase4:36669] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:53,191 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,191 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:53,192 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,192 INFO [RS:0;jenkins-hbase4:38465] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 DEBUG [RS:1;jenkins-hbase4:36669] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,193 INFO [RS:0;jenkins-hbase4:38465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:53,193 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,198 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:53,198 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,199 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,199 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,199 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,200 DEBUG [RS:0;jenkins-hbase4:38465] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:53,201 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,202 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,202 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,210 INFO [RS:1;jenkins-hbase4:36669] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:53,210 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36669,1676494912936-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,211 INFO [RS:0;jenkins-hbase4:38465] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:53,211 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38465,1676494912912-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,221 INFO [RS:1;jenkins-hbase4:36669] regionserver.Replication(203): jenkins-hbase4.apache.org,36669,1676494912936 started 2023-02-15 21:01:53,222 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36669,1676494912936, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36669, sessionid=0x10059ca270e0002 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36669,1676494912936' 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:53,222 INFO [RS:0;jenkins-hbase4:38465] regionserver.Replication(203): jenkins-hbase4.apache.org,38465,1676494912912 started 2023-02-15 21:01:53,222 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38465,1676494912912, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38465, sessionid=0x10059ca270e0001 2023-02-15 21:01:53,222 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:53,222 DEBUG [RS:0;jenkins-hbase4:38465] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,222 DEBUG [RS:0;jenkins-hbase4:38465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38465,1676494912912' 2023-02-15 21:01:53,222 DEBUG [RS:0;jenkins-hbase4:38465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36669,1676494912936' 2023-02-15 21:01:53,222 DEBUG [RS:1;jenkins-hbase4:36669] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:53,222 DEBUG [RS:0;jenkins-hbase4:38465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:53,223 DEBUG [RS:1;jenkins-hbase4:36669] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38465,1676494912912' 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:53,223 DEBUG [RS:1;jenkins-hbase4:36669] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:53,223 INFO [RS:1;jenkins-hbase4:36669] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:53,223 INFO [RS:1;jenkins-hbase4:36669] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:53,223 DEBUG [RS:0;jenkins-hbase4:38465] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:53,223 INFO [RS:0;jenkins-hbase4:38465] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:53,223 INFO [RS:0;jenkins-hbase4:38465] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:53,251 DEBUG [jenkins-hbase4:40313] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:53,251 DEBUG [jenkins-hbase4:40313] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:53,253 DEBUG [jenkins-hbase4:40313] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:53,253 DEBUG [jenkins-hbase4:40313] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:53,253 DEBUG [jenkins-hbase4:40313] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:53,253 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38465,1676494912912, state=OPENING 2023-02-15 21:01:53,254 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:53,255 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:53,256 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:53,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38465,1676494912912}] 2023-02-15 21:01:53,410 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:53,410 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:53,412 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39572, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:53,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:53,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:53,416 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38465%2C1676494912912.meta, suffix=.meta, logDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,38465,1676494912912, archiveDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/oldWALs, maxLogs=32 2023-02-15 21:01:53,429 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK] 2023-02-15 21:01:53,429 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK] 2023-02-15 21:01:53,431 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,38465,1676494912912/jenkins-hbase4.apache.org%2C38465%2C1676494912912.meta.1676494913417.meta 2023-02-15 21:01:53,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK], DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK]] 2023-02-15 21:01:53,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:53,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:53,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:53,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:53,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:53,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:53,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:53,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:53,436 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/info 2023-02-15 21:01:53,436 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/info 2023-02-15 21:01:53,436 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:53,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:53,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:53,437 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:53,438 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:53,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,438 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:53,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/table 2023-02-15 21:01:53,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/table 2023-02-15 21:01:53,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:53,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740 2023-02-15 21:01:53,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740 2023-02-15 21:01:53,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:53,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:53,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74542636, jitterRate=0.11077183485031128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:53,443 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:53,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494913410 2023-02-15 21:01:53,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:53,447 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:53,447 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38465,1676494912912, state=OPEN 2023-02-15 21:01:53,448 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:53,448 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:53,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:53,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38465,1676494912912 in 193 msec 2023-02-15 21:01:53,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:53,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-15 21:01:53,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 387 msec 2023-02-15 21:01:53,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494913452, completionTime=-1 2023-02-15 21:01:53,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:53,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:53,454 DEBUG [hconnection-0x7e02fe63-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:53,456 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39588, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:53,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:53,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494973457 2023-02-15 21:01:53,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676495033457 2023-02-15 21:01:53,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-15 21:01:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40313,1676494912859-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40313,1676494912859-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40313,1676494912859-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40313, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:53,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:53,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:53,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:53,468 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:53,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:53,469 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:53,470 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,470 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc empty. 2023-02-15 21:01:53,471 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:53,478 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:53,480 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 52be51d08a3f30914d7a54e3ddb734cc, NAME => 'hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp 2023-02-15 21:01:53,485 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,485 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 52be51d08a3f30914d7a54e3ddb734cc, disabling compactions & flushes 2023-02-15 21:01:53,485 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,486 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,486 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. after waiting 0 ms 2023-02-15 21:01:53,486 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,486 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,486 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 52be51d08a3f30914d7a54e3ddb734cc: 2023-02-15 21:01:53,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:53,488 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494913488"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494913488"}]},"ts":"1676494913488"} 2023-02-15 21:01:53,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:53,490 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:53,490 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494913490"}]},"ts":"1676494913490"} 2023-02-15 21:01:53,491 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:53,493 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:53,494 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:53,494 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:53,494 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:53,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52be51d08a3f30914d7a54e3ddb734cc, ASSIGN}] 2023-02-15 21:01:53,496 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52be51d08a3f30914d7a54e3ddb734cc, ASSIGN 2023-02-15 21:01:53,496 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=52be51d08a3f30914d7a54e3ddb734cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36669,1676494912936; forceNewPlan=false, retain=false 2023-02-15 21:01:53,647 INFO [jenkins-hbase4:40313] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:53,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52be51d08a3f30914d7a54e3ddb734cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494913647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494913647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494913647"}]},"ts":"1676494913647"} 2023-02-15 21:01:53,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 52be51d08a3f30914d7a54e3ddb734cc, server=jenkins-hbase4.apache.org,36669,1676494912936}] 2023-02-15 21:01:53,801 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,801 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:53,803 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:53,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,808 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36669%2C1676494912936, suffix=, logDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,36669,1676494912936, archiveDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/oldWALs, maxLogs=32 2023-02-15 21:01:53,823 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK] 2023-02-15 21:01:53,823 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK] 2023-02-15 21:01:53,825 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,36669,1676494912936/jenkins-hbase4.apache.org%2C36669%2C1676494912936.1676494913808 2023-02-15 21:01:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK], DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK]] 2023-02-15 21:01:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 52be51d08a3f30914d7a54e3ddb734cc, NAME => 'hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,826 INFO [StoreOpener-52be51d08a3f30914d7a54e3ddb734cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,827 DEBUG [StoreOpener-52be51d08a3f30914d7a54e3ddb734cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/info 2023-02-15 21:01:53,827 DEBUG [StoreOpener-52be51d08a3f30914d7a54e3ddb734cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/info 2023-02-15 21:01:53,828 INFO [StoreOpener-52be51d08a3f30914d7a54e3ddb734cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52be51d08a3f30914d7a54e3ddb734cc columnFamilyName info 2023-02-15 21:01:53,828 INFO [StoreOpener-52be51d08a3f30914d7a54e3ddb734cc-1] regionserver.HStore(310): Store=52be51d08a3f30914d7a54e3ddb734cc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:53,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,831 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:53,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:53,833 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 52be51d08a3f30914d7a54e3ddb734cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61269760, jitterRate=-0.08700942993164062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:53,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 52be51d08a3f30914d7a54e3ddb734cc: 2023-02-15 21:01:53,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc., pid=6, masterSystemTime=1676494913801 2023-02-15 21:01:53,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,837 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:53,838 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52be51d08a3f30914d7a54e3ddb734cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:53,838 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494913837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494913837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494913837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494913837"}]},"ts":"1676494913837"} 2023-02-15 21:01:53,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:53,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 52be51d08a3f30914d7a54e3ddb734cc, server=jenkins-hbase4.apache.org,36669,1676494912936 in 190 msec 2023-02-15 21:01:53,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:53,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=52be51d08a3f30914d7a54e3ddb734cc, ASSIGN in 346 msec 2023-02-15 21:01:53,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:53,842 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494913842"}]},"ts":"1676494913842"} 2023-02-15 21:01:53,843 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:53,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:53,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-15 21:01:53,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:53,869 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:53,869 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:53,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:53,872 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:53,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:53,880 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:53,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-15 21:01:53,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:53,892 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:53,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-15 21:01:53,898 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:53,901 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:53,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.940sec 2023-02-15 21:01:53,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:53,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:53,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:53,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40313,1676494912859-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:53,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40313,1676494912859-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:53,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:53,953 DEBUG [Listener at localhost/36693] zookeeper.ReadOnlyZKClient(139): Connect 0x3ab55c4a to 127.0.0.1:52554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:53,956 DEBUG [Listener at localhost/36693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67caf6aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:53,957 DEBUG [hconnection-0x5c5ea92f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:53,959 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39596, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:53,960 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:53,960 DEBUG [Listener at localhost/36693] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:53,962 DEBUG [Listener at localhost/36693] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:53,964 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:53,964 INFO [Listener at localhost/36693] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:53,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:53,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:53,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:43256 deadline: 1676494973964, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:53,965 INFO [Listener at localhost/36693] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 21:01:53,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:53,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:53,969 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:53,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-15 21:01:53,969 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:53,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:53,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:53,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab empty. 2023-02-15 21:01:53,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:53,971 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 21:01:53,979 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:53,980 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41990f9ad65d581e82c99fc531d9a6ab, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp 2023-02-15 21:01:53,990 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:53,990 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 41990f9ad65d581e82c99fc531d9a6ab, disabling compactions & flushes 2023-02-15 21:01:53,990 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:53,990 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:53,990 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. after waiting 0 ms 2023-02-15 21:01:53,990 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:53,990 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:53,990 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 41990f9ad65d581e82c99fc531d9a6ab: 2023-02-15 21:01:53,992 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:53,993 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676494913993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494913993"}]},"ts":"1676494913993"} 2023-02-15 21:01:53,994 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:53,995 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:53,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494913995"}]},"ts":"1676494913995"} 2023-02-15 21:01:53,996 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-15 21:01:53,999 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:54,000 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:54,000 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:54,000 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:54,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, ASSIGN}] 2023-02-15 21:01:54,002 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, ASSIGN 2023-02-15 21:01:54,003 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36669,1676494912936; forceNewPlan=false, retain=false 2023-02-15 21:01:54,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:54,153 INFO [jenkins-hbase4:40313] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:54,153 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=41990f9ad65d581e82c99fc531d9a6ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,153 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676494914153"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494914153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494914153"}]},"ts":"1676494914153"} 2023-02-15 21:01:54,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 41990f9ad65d581e82c99fc531d9a6ab, server=jenkins-hbase4.apache.org,36669,1676494912936}] 2023-02-15 21:01:54,176 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 21:01:54,225 INFO [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38465%2C1676494912912, suffix=, logDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,38465,1676494912912, archiveDir=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/oldWALs, maxLogs=32 2023-02-15 21:01:54,239 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK] 2023-02-15 21:01:54,239 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK] 2023-02-15 21:01:54,242 INFO [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/WALs/jenkins-hbase4.apache.org,38465,1676494912912/jenkins-hbase4.apache.org%2C38465%2C1676494912912.1676494914225 2023-02-15 21:01:54,244 DEBUG [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46641,DS-61341075-3a58-4e25-9ae3-956b6725e730,DISK], DatanodeInfoWithStorage[127.0.0.1:43085,DS-210828d9-c70b-4cdb-a5a1-5e79ffe5c75a,DISK]] 2023-02-15 21:01:54,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:54,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:54,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41990f9ad65d581e82c99fc531d9a6ab, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:54,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:54,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,311 INFO [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,312 DEBUG [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1 2023-02-15 21:01:54,313 DEBUG [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1 2023-02-15 21:01:54,313 INFO [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41990f9ad65d581e82c99fc531d9a6ab columnFamilyName f1 2023-02-15 21:01:54,313 INFO [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] regionserver.HStore(310): Store=41990f9ad65d581e82c99fc531d9a6ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:54,314 INFO [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,315 DEBUG [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2 2023-02-15 21:01:54,315 DEBUG [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2 2023-02-15 21:01:54,315 INFO [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41990f9ad65d581e82c99fc531d9a6ab columnFamilyName f2 2023-02-15 21:01:54,315 INFO [StoreOpener-41990f9ad65d581e82c99fc531d9a6ab-1] regionserver.HStore(310): Store=41990f9ad65d581e82c99fc531d9a6ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:54,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:54,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:54,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:54,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41990f9ad65d581e82c99fc531d9a6ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68142714, jitterRate=0.0154055655002594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:54,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41990f9ad65d581e82c99fc531d9a6ab: 2023-02-15 21:01:54,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab., pid=12, masterSystemTime=1676494914306 2023-02-15 21:01:54,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:54,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:54,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=41990f9ad65d581e82c99fc531d9a6ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676494914324"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494914324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494914324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494914324"}]},"ts":"1676494914324"} 2023-02-15 21:01:54,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 21:01:54,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 41990f9ad65d581e82c99fc531d9a6ab, server=jenkins-hbase4.apache.org,36669,1676494912936 in 170 msec 2023-02-15 21:01:54,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 21:01:54,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, ASSIGN in 326 msec 2023-02-15 21:01:54,329 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:54,329 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494914329"}]},"ts":"1676494914329"} 2023-02-15 21:01:54,331 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-15 21:01:54,333 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:54,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 366 msec 2023-02-15 21:01:54,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:54,574 INFO [Listener at localhost/36693] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-15 21:01:54,574 DEBUG [Listener at localhost/36693] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-15 21:01:54,574 INFO [Listener at localhost/36693] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:54,576 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-15 21:01:54,577 INFO [Listener at localhost/36693] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:54,577 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-15 21:01:54,577 INFO [Listener at localhost/36693] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:54,589 DEBUG [hconnection-0x5c5ea92f-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:54,606 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:54,613 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:54,694 INFO [Listener at localhost/36693] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:54,694 INFO [Listener at localhost/36693] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:54,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 21:01:54,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494914695 (current time:1676494914695). 2023-02-15 21:01:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] zookeeper.ReadOnlyZKClient(139): Connect 0x567e7a2e to 127.0.0.1:52554 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:54,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@791ba19d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:54,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:54,701 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:54,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x567e7a2e to 127.0.0.1:52554 2023-02-15 21:01:54,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:54,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 21:01:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 21:01:54,705 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 21:01:54,706 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676495514706 2023-02-15 21:01:54,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-15 21:01:54,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:54,707 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:54,707 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:54,708 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-15 21:01:54,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 21:01:54,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-15 21:01:54,710 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 21:01:54,710 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676495514710 2023-02-15 21:01:54,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-15 21:01:54,717 INFO [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-15 21:01:54,717 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:54,718 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-15 21:01:54,718 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-15 21:01:54,718 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,718 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,720 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,720 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:54,720 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:54,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:54,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:54,721 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,721 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 21:01:54,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-15 21:01:54,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 21:01:54,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-15 21:01:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 21:01:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36669,1676494912936' joining acquired barrier for procedure (foo) in zk 2023-02-15 21:01:54,723 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38465,1676494912912' joining acquired barrier for procedure (foo) in zk 2023-02-15 21:01:54,725 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:54,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36669,1676494912936' joining acquired barrier for procedure 'foo' on coordinator 2023-02-15 21:01:54,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dc411de[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:54,726 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-15 21:01:54,726 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,727 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,727 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 21:01:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-15 21:01:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 21:01:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38465,1676494912912' in zk 2023-02-15 21:01:54,728 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,728 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:54,728 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 21:01:54,728 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. started... 2023-02-15 21:01:54,728 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:54,728 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 41990f9ad65d581e82c99fc531d9a6ab 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 21:01:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 21:01:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 21:01:54,747 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 2023-02-15 21:01:54,763 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f2/1b41622246a04819aa4e29241e2bf533 2023-02-15 21:01:54,767 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 2023-02-15 21:01:54,770 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:54,771 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f2/1b41622246a04819aa4e29241e2bf533 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533 2023-02-15 21:01:54,774 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:54,775 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 41990f9ad65d581e82c99fc531d9a6ab in 46ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 41990f9ad65d581e82c99fc531d9a6ab: 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.' region-info for snapshot=foo 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541] hfiles 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 for snapshot=foo 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533] hfiles 2023-02-15 21:01:54,775 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533 for snapshot=foo 2023-02-15 21:01:54,783 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. completed. 2023-02-15 21:01:54,783 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:54,783 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 21:01:54,783 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 21:01:54,783 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,783 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-15 21:01:54,783 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36669,1676494912936' in zk 2023-02-15 21:01:54,786 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,786 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-15 21:01:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:54,786 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:54,786 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-15 21:01:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,36669,1676494912936': 2023-02-15 21:01:54,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36669,1676494912936' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-15 21:01:54,789 INFO [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-15 21:01:54,789 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:54,789 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:54,789 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-15 21:01:54,789 INFO [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:54,791 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:54,791 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:54,791 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:54,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:54,791 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:54,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:54,792 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,793 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:54,793 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-15 21:01:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,798 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:54,798 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:54,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:54,798 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:54,798 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:54,798 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:54,798 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-15 21:01:54,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:54,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:54,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-15 21:01:54,798 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:54,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-15 21:01:54,799 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-15 21:01:54,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.hbase-snapshot/.tmp/foo 2023-02-15 21:01:54,807 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:54,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 21:01:54,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:54,809 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:54,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.hbase-snapshot/.tmp/foo to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.hbase-snapshot/foo 2023-02-15 21:01:54,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-15 21:01:54,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.hbase-snapshot/.tmp/foo 2023-02-15 21:01:54,830 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.hbase-snapshot/.tmp/foo 2023-02-15 21:01:54,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676494914706Consolidate snapshot: foo at 1676494914798 (+92 ms)Loading Region manifests for foo at 1676494914799 (+1 ms)Writing data manifest for foo at 1676494914801 (+2 ms)Verifying snapshot: foo at 1676494914810 (+9 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676494914830 (+20 ms) 2023-02-15 21:01:54,832 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-15 21:01:54,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 125 msec 2023-02-15 21:01:55,009 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:55,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-15 21:01:55,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:55,011 INFO [Listener at localhost/36693] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:55,014 INFO [Listener at localhost/36693] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:55,018 INFO [Listener at localhost/36693] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:55,045 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36669] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,126 INFO [Listener at localhost/36693] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:55,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:55,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,133 INFO [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 21:01:55,133 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:55,134 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-15 21:01:55,134 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-15 21:01:55,135 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,135 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,139 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:55,139 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:55,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:55,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:55,139 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,140 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,140 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,141 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,141 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,141 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 21:01:55,141 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 21:01:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 21:01:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-15 21:01:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38465,1676494912912' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 21:01:55,142 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-15 21:01:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 21:01:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:55,143 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,143 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. started... 2023-02-15 21:01:55,143 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 41990f9ad65d581e82c99fc531d9a6ab 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 21:01:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:55,157 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f1/750d9f43acd74629874ea29df43734a4 2023-02-15 21:01:55,174 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f2/32e9160db9674b69838a3101eb910be1 2023-02-15 21:01:55,177 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f1/750d9f43acd74629874ea29df43734a4 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/750d9f43acd74629874ea29df43734a4 2023-02-15 21:01:55,181 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/750d9f43acd74629874ea29df43734a4, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:55,181 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/.tmp/f2/32e9160db9674b69838a3101eb910be1 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/32e9160db9674b69838a3101eb910be1 2023-02-15 21:01:55,185 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/32e9160db9674b69838a3101eb910be1, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:55,185 INFO [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 41990f9ad65d581e82c99fc531d9a6ab in 42ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:55,186 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 41990f9ad65d581e82c99fc531d9a6ab: 2023-02-15 21:01:55,186 DEBUG [rs(jenkins-hbase4.apache.org,36669,1676494912936)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 21:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 21:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-15 21:01:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36669,1676494912936' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-15 21:01:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,188 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,188 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36669,1676494912936' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-15 21:01:55,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29fb80be[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:55,190 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-15 21:01:55,190 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 21:01:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-15 21:01:55,191 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,191 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 21:01:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-15 21:01:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,38465,1676494912912' in zk 2023-02-15 21:01:55,191 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,36669,1676494912936' in zk 2023-02-15 21:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 21:01:55,194 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-15 21:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,38465,1676494912912' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 21:01:55,194 DEBUG [member: 'jenkins-hbase4.apache.org,36669,1676494912936' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-15 21:01:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,36669,1676494912936': 2023-02-15 21:01:55,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36669,1676494912936' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-15 21:01:55,196 INFO [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-15 21:01:55,196 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:55,196 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:55,196 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,197 INFO [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:55,198 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,198 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:55,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:55,199 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,199 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:55,201 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,201 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:55,203 DEBUG [(jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:55,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:55,203 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-15 21:01:55,204 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,204 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:55,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:55,204 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:01:55,204 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:55,204 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:55,204 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:55,205 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:01:55,305 DEBUG [Listener at localhost/36693] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:01:55,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:01:55,309 INFO [Listener at localhost/36693] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676494914695 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:55,309 DEBUG [Listener at localhost/36693] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41347/user/jenkins/test-data/c6469ede-49b5-f1bc-baa0-bcef5e9affd4/foo/7bd3c737-8e4f-4433-a0a5-8ac449935981/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,310 INFO [Listener at localhost/36693] snapshot.RestoreSnapshotHelper(239): region to add: 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:55,310 INFO [Listener at localhost/36693] snapshot.RestoreSnapshotHelper(585): clone region=41990f9ad65d581e82c99fc531d9a6ab as 41990f9ad65d581e82c99fc531d9a6ab in snapshot foo 2023-02-15 21:01:55,310 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41990f9ad65d581e82c99fc531d9a6ab, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41347/user/jenkins/test-data/c6469ede-49b5-f1bc-baa0-bcef5e9affd4/foo/7bd3c737-8e4f-4433-a0a5-8ac449935981 2023-02-15 21:01:55,316 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:55,316 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7ccc9204c34645b0a0bdd1ccc8ec1541 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,318 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b41622246a04819aa4e29241e2bf533 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,319 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 41990f9ad65d581e82c99fc531d9a6ab, disabling compactions & flushes 2023-02-15 21:01:55,319 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,319 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,319 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. after waiting 0 ms 2023-02-15 21:01:55,319 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,319 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,319 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 41990f9ad65d581e82c99fc531d9a6ab: 2023-02-15 21:01:55,321 INFO [Listener at localhost/36693] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676494914695 type: FLUSH version: 2 ttl: 0 2023-02-15 21:01:55,321 DEBUG [Listener at localhost/36693] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41347/user/jenkins/test-data/c6469ede-49b5-f1bc-baa0-bcef5e9affd4/foo/7bd3c737-8e4f-4433-a0a5-8ac449935981 2023-02-15 21:01:55,321 DEBUG [Listener at localhost/36693] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41347/user/jenkins/test-data/c6469ede-49b5-f1bc-baa0-bcef5e9affd4/foo/7bd3c737-8e4f-4433-a0a5-8ac449935981 2023-02-15 21:01:55,321 DEBUG [Listener at localhost/36693] util.CommonFSUtils(699): |-data/ 2023-02-15 21:01:55,322 DEBUG [Listener at localhost/36693] util.CommonFSUtils(699): |----default/ 2023-02-15 21:01:55,322 DEBUG [Listener at localhost/36693] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-15 21:01:55,322 DEBUG [Listener at localhost/36693] util.CommonFSUtils(699): |----------41990f9ad65d581e82c99fc531d9a6ab/ 2023-02-15 21:01:55,323 DEBUG [Listener at localhost/36693] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:01:55,323 DEBUG [Listener at localhost/36693] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:01:55,323 DEBUG [Listener at localhost/36693] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=41990f9ad65d581e82c99fc531d9a6ab-7ccc9204c34645b0a0bdd1ccc8ec1541 2023-02-15 21:01:55,323 DEBUG [Listener at localhost/36693] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:01:55,323 DEBUG [Listener at localhost/36693] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=41990f9ad65d581e82c99fc531d9a6ab-1b41622246a04819aa4e29241e2bf533 hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/750d9f43acd74629874ea29df43734a4 hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533 hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/32e9160db9674b69838a3101eb910be1 2023-02-15 21:01:55,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-15 21:01:55,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-15 21:01:55,331 INFO [Listener at localhost/36693] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494915335"}]},"ts":"1676494915335"} 2023-02-15 21:01:55,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:55,336 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-15 21:01:55,337 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-15 21:01:55,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, UNASSIGN}] 2023-02-15 21:01:55,339 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, UNASSIGN 2023-02-15 21:01:55,340 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=41990f9ad65d581e82c99fc531d9a6ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676494915340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494915340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494915340"}]},"ts":"1676494915340"} 2023-02-15 21:01:55,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 41990f9ad65d581e82c99fc531d9a6ab, server=jenkins-hbase4.apache.org,36669,1676494912936}] 2023-02-15 21:01:55,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:55,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:55,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41990f9ad65d581e82c99fc531d9a6ab, disabling compactions & flushes 2023-02-15 21:01:55,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. after waiting 0 ms 2023-02-15 21:01:55,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:01:55,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab. 2023-02-15 21:01:55,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41990f9ad65d581e82c99fc531d9a6ab: 2023-02-15 21:01:55,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:55,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=41990f9ad65d581e82c99fc531d9a6ab, regionState=CLOSED 2023-02-15 21:01:55,499 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676494915499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494915499"}]},"ts":"1676494915499"} 2023-02-15 21:01:55,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 21:01:55,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 41990f9ad65d581e82c99fc531d9a6ab, server=jenkins-hbase4.apache.org,36669,1676494912936 in 159 msec 2023-02-15 21:01:55,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 21:01:55,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=41990f9ad65d581e82c99fc531d9a6ab, UNASSIGN in 163 msec 2023-02-15 21:01:55,503 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494915503"}]},"ts":"1676494915503"} 2023-02-15 21:01:55,504 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-15 21:01:55,506 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-15 21:01:55,508 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 175 msec 2023-02-15 21:01:55,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:01:55,638 INFO [Listener at localhost/36693] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-15 21:01:55,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,641 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,642 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:01:55,645 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:55,647 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1, FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2, FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/recovered.edits] 2023-02-15 21:01:55,649 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/750d9f43acd74629874ea29df43734a4 to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/750d9f43acd74629874ea29df43734a4 2023-02-15 21:01:55,650 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f1/7ccc9204c34645b0a0bdd1ccc8ec1541 2023-02-15 21:01:55,652 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533 to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/1b41622246a04819aa4e29241e2bf533 2023-02-15 21:01:55,653 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/32e9160db9674b69838a3101eb910be1 to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/f2/32e9160db9674b69838a3101eb910be1 2023-02-15 21:01:55,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/recovered.edits/12.seqid to hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab/recovered.edits/12.seqid 2023-02-15 21:01:55,656 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/41990f9ad65d581e82c99fc531d9a6ab 2023-02-15 21:01:55,656 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-15 21:01:55,658 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,659 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-15 21:01:55,660 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-15 21:01:55,664 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,664 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-15 21:01:55,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494915664"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:55,665 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 21:01:55,665 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 41990f9ad65d581e82c99fc531d9a6ab, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676494913967.41990f9ad65d581e82c99fc531d9a6ab.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 21:01:55,665 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-15 21:01:55,665 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676494915665"}]},"ts":"9223372036854775807"} 2023-02-15 21:01:55,666 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-15 21:01:55,668 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-15 21:01:55,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 29 msec 2023-02-15 21:01:55,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40313] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:01:55,744 INFO [Listener at localhost/36693] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-15 21:01:55,745 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:01:55,745 INFO [Listener at localhost/36693] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:01:55,745 DEBUG [Listener at localhost/36693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ab55c4a to 127.0.0.1:52554 2023-02-15 21:01:55,745 DEBUG [Listener at localhost/36693] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,745 DEBUG [Listener at localhost/36693] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:01:55,745 DEBUG [Listener at localhost/36693] util.JVMClusterUtil(257): Found active master hash=1993609890, stopped=false 2023-02-15 21:01:55,745 INFO [Listener at localhost/36693] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:55,747 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:55,747 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:55,747 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:55,747 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:55,747 INFO [Listener at localhost/36693] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:01:55,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:55,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:55,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:55,749 DEBUG [Listener at localhost/36693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x742c4d19 to 127.0.0.1:52554 2023-02-15 21:01:55,749 DEBUG [Listener at localhost/36693] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,749 INFO [Listener at localhost/36693] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38465,1676494912912' ***** 2023-02-15 21:01:55,749 INFO [Listener at localhost/36693] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:55,749 INFO [Listener at localhost/36693] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36669,1676494912936' ***** 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:55,750 INFO [Listener at localhost/36693] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:55,750 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,750 DEBUG [RS:0;jenkins-hbase4:38465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5349002d to 127.0.0.1:52554 2023-02-15 21:01:55,750 DEBUG [RS:0;jenkins-hbase4:38465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:01:55,750 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 21:01:55,750 INFO [RS:1;jenkins-hbase4:36669] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:01:55,750 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-15 21:01:55,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:55,752 DEBUG [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-15 21:01:55,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:55,751 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:01:55,751 INFO [RS:1;jenkins-hbase4:36669] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:01:55,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:55,752 INFO [RS:1;jenkins-hbase4:36669] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:01:55,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:55,752 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(3304): Received CLOSE for 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:55,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:55,753 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-15 21:01:55,753 DEBUG [RS:1;jenkins-hbase4:36669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b2413e7 to 127.0.0.1:52554 2023-02-15 21:01:55,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 52be51d08a3f30914d7a54e3ddb734cc, disabling compactions & flushes 2023-02-15 21:01:55,753 DEBUG [RS:1;jenkins-hbase4:36669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:55,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:55,753 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-15 21:01:55,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. after waiting 0 ms 2023-02-15 21:01:55,754 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1479): Online Regions={52be51d08a3f30914d7a54e3ddb734cc=hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc.} 2023-02-15 21:01:55,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:55,754 DEBUG [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1505): Waiting on 52be51d08a3f30914d7a54e3ddb734cc 2023-02-15 21:01:55,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 52be51d08a3f30914d7a54e3ddb734cc 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:01:55,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/.tmp/info/98828b3d639e4374abac1eea0e513dd5 2023-02-15 21:01:55,764 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/.tmp/info/dbb5451a44f2434a905da4981fe91785 2023-02-15 21:01:55,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbb5451a44f2434a905da4981fe91785 2023-02-15 21:01:55,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/.tmp/info/98828b3d639e4374abac1eea0e513dd5 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/info/98828b3d639e4374abac1eea0e513dd5 2023-02-15 21:01:55,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/info/98828b3d639e4374abac1eea0e513dd5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:01:55,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 52be51d08a3f30914d7a54e3ddb734cc in 22ms, sequenceid=6, compaction requested=false 2023-02-15 21:01:55,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/.tmp/rep_barrier/7b20d7a0243f486bbc1988b451538f4d 2023-02-15 21:01:55,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/namespace/52be51d08a3f30914d7a54e3ddb734cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:01:55,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:55,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 52be51d08a3f30914d7a54e3ddb734cc: 2023-02-15 21:01:55,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494913466.52be51d08a3f30914d7a54e3ddb734cc. 2023-02-15 21:01:55,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b20d7a0243f486bbc1988b451538f4d 2023-02-15 21:01:55,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/.tmp/table/88c596e1bb134ef988937df27b7d44e9 2023-02-15 21:01:55,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88c596e1bb134ef988937df27b7d44e9 2023-02-15 21:01:55,794 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/.tmp/info/dbb5451a44f2434a905da4981fe91785 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/info/dbb5451a44f2434a905da4981fe91785 2023-02-15 21:01:55,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbb5451a44f2434a905da4981fe91785 2023-02-15 21:01:55,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/info/dbb5451a44f2434a905da4981fe91785, entries=12, sequenceid=21, filesize=6.3 K 2023-02-15 21:01:55,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/.tmp/rep_barrier/7b20d7a0243f486bbc1988b451538f4d as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/rep_barrier/7b20d7a0243f486bbc1988b451538f4d 2023-02-15 21:01:55,800 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b20d7a0243f486bbc1988b451538f4d 2023-02-15 21:01:55,800 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/rep_barrier/7b20d7a0243f486bbc1988b451538f4d, entries=1, sequenceid=21, filesize=5.1 K 2023-02-15 21:01:55,801 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:55,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/.tmp/table/88c596e1bb134ef988937df27b7d44e9 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/table/88c596e1bb134ef988937df27b7d44e9 2023-02-15 21:01:55,803 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:55,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88c596e1bb134ef988937df27b7d44e9 2023-02-15 21:01:55,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/table/88c596e1bb134ef988937df27b7d44e9, entries=4, sequenceid=21, filesize=5.1 K 2023-02-15 21:01:55,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-15 21:01:55,812 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 21:01:55,812 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:01:55,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:55,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:55,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:55,952 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38465,1676494912912; all regions closed. 2023-02-15 21:01:55,954 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36669,1676494912936; all regions closed. 2023-02-15 21:01:55,959 DEBUG [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/oldWALs 2023-02-15 21:01:55,959 INFO [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38465%2C1676494912912.meta:.meta(num 1676494913417) 2023-02-15 21:01:55,960 DEBUG [RS:1;jenkins-hbase4:36669] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/oldWALs 2023-02-15 21:01:55,960 INFO [RS:1;jenkins-hbase4:36669] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36669%2C1676494912936:(num 1676494913808) 2023-02-15 21:01:55,960 DEBUG [RS:1;jenkins-hbase4:36669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,960 INFO [RS:1;jenkins-hbase4:36669] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:55,960 INFO [RS:1;jenkins-hbase4:36669] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:55,960 INFO [RS:1;jenkins-hbase4:36669] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:01:55,960 INFO [RS:1;jenkins-hbase4:36669] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:01:55,960 INFO [RS:1;jenkins-hbase4:36669] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:01:55,961 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:55,962 INFO [RS:1;jenkins-hbase4:36669] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36669 2023-02-15 21:01:55,963 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,963 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36669,1676494912936 2023-02-15 21:01:55,963 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:55,963 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:55,963 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:55,963 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1180cf6d rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:55,964 DEBUG [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/oldWALs 2023-02-15 21:01:55,964 INFO [RS:0;jenkins-hbase4:38465] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38465%2C1676494912912:(num 1676494914225) 2023-02-15 21:01:55,964 DEBUG [RS:0;jenkins-hbase4:38465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,964 INFO [RS:0;jenkins-hbase4:38465] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:01:55,964 INFO [RS:0;jenkins-hbase4:38465] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:01:55,964 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:55,965 INFO [RS:0;jenkins-hbase4:38465] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38465 2023-02-15 21:01:55,965 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36669,1676494912936] 2023-02-15 21:01:55,965 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36669,1676494912936; numProcessing=1 2023-02-15 21:01:55,966 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38465,1676494912912 2023-02-15 21:01:55,966 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:55,966 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@129a887e rejected from java.util.concurrent.ThreadPoolExecutor@16a50ef5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:55,967 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36669,1676494912936 already deleted, retry=false 2023-02-15 21:01:55,967 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36669,1676494912936 expired; onlineServers=1 2023-02-15 21:01:55,967 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38465,1676494912912] 2023-02-15 21:01:55,967 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38465,1676494912912; numProcessing=2 2023-02-15 21:01:55,969 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38465,1676494912912 already deleted, retry=false 2023-02-15 21:01:55,969 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38465,1676494912912 expired; onlineServers=0 2023-02-15 21:01:55,969 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40313,1676494912859' ***** 2023-02-15 21:01:55,969 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:01:55,970 DEBUG [M:0;jenkins-hbase4:40313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72eb98a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:55,970 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40313,1676494912859 2023-02-15 21:01:55,970 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40313,1676494912859; all regions closed. 2023-02-15 21:01:55,970 DEBUG [M:0;jenkins-hbase4:40313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:55,970 DEBUG [M:0;jenkins-hbase4:40313] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:01:55,970 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:01:55,970 DEBUG [M:0;jenkins-hbase4:40313] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:01:55,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494913070] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494913070,5,FailOnTimeoutGroup] 2023-02-15 21:01:55,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494913070] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494913070,5,FailOnTimeoutGroup] 2023-02-15 21:01:55,970 INFO [M:0;jenkins-hbase4:40313] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:01:55,971 INFO [M:0;jenkins-hbase4:40313] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:01:55,971 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:55,972 INFO [M:0;jenkins-hbase4:40313] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:01:55,972 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:55,972 DEBUG [M:0;jenkins-hbase4:40313] master.HMaster(1512): Stopping service threads 2023-02-15 21:01:55,972 INFO [M:0;jenkins-hbase4:40313] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:01:55,972 ERROR [M:0;jenkins-hbase4:40313] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 21:01:55,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:55,972 INFO [M:0;jenkins-hbase4:40313] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:01:55,973 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:01:55,973 DEBUG [M:0;jenkins-hbase4:40313] zookeeper.ZKUtil(398): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:01:55,973 WARN [M:0;jenkins-hbase4:40313] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:01:55,973 INFO [M:0;jenkins-hbase4:40313] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:01:55,973 INFO [M:0;jenkins-hbase4:40313] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:01:55,973 DEBUG [M:0;jenkins-hbase4:40313] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:55,974 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:55,974 DEBUG [M:0;jenkins-hbase4:40313] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:55,974 DEBUG [M:0;jenkins-hbase4:40313] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:55,974 DEBUG [M:0;jenkins-hbase4:40313] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:55,974 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.61 KB 2023-02-15 21:01:55,985 INFO [M:0;jenkins-hbase4:40313] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a7970765a1634567a5ff4a8cc6aacdb6 2023-02-15 21:01:55,989 DEBUG [M:0;jenkins-hbase4:40313] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a7970765a1634567a5ff4a8cc6aacdb6 as hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a7970765a1634567a5ff4a8cc6aacdb6 2023-02-15 21:01:55,993 INFO [M:0;jenkins-hbase4:40313] regionserver.HStore(1080): Added hdfs://localhost:41347/user/jenkins/test-data/e6dce0c9-62c0-f138-2b38-6fddd1e45c00/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a7970765a1634567a5ff4a8cc6aacdb6, entries=17, sequenceid=132, filesize=8.7 K 2023-02-15 21:01:55,994 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58012, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-15 21:01:55,994 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:55,994 DEBUG [M:0;jenkins-hbase4:40313] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:55,996 INFO [M:0;jenkins-hbase4:40313] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:01:55,997 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:01:55,997 INFO [M:0;jenkins-hbase4:40313] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40313 2023-02-15 21:01:55,999 DEBUG [M:0;jenkins-hbase4:40313] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40313,1676494912859 already deleted, retry=false 2023-02-15 21:01:56,248 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:56,248 INFO [M:0;jenkins-hbase4:40313] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40313,1676494912859; zookeeper connection closed. 2023-02-15 21:01:56,249 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38587144 rejected from java.util.concurrent.ThreadPoolExecutor@3c67f297[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:56,250 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): master:40313-0x10059ca270e0000, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:56,250 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@337f8515 rejected from java.util.concurrent.ThreadPoolExecutor@3c67f297[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:56,349 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:56,349 INFO [RS:0;jenkins-hbase4:38465] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38465,1676494912912; zookeeper connection closed. 2023-02-15 21:01:56,349 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@24a1b4f9 rejected from java.util.concurrent.ThreadPoolExecutor@16a50ef5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:56,349 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:38465-0x10059ca270e0001, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:56,349 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c52796f rejected from java.util.concurrent.ThreadPoolExecutor@16a50ef5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:56,349 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@77b9fa4d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@77b9fa4d 2023-02-15 21:01:56,449 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:56,449 INFO [RS:1;jenkins-hbase4:36669] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36669,1676494912936; zookeeper connection closed. 2023-02-15 21:01:56,449 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@764b153e rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:56,449 DEBUG [Listener at localhost/36693-EventThread] zookeeper.ZKWatcher(600): regionserver:36669-0x10059ca270e0002, quorum=127.0.0.1:52554, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:01:56,449 ERROR [Listener at localhost/36693-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ebbd9ed rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:01:56,449 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71c2368a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71c2368a 2023-02-15 21:01:56,450 INFO [Listener at localhost/36693] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:01:56,450 WARN [Listener at localhost/36693] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:56,454 INFO [Listener at localhost/36693] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:56,555 WARN [BP-492168115-172.31.14.131-1676494912182 heartbeating to localhost/127.0.0.1:41347] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:56,555 WARN [BP-492168115-172.31.14.131-1676494912182 heartbeating to localhost/127.0.0.1:41347] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-492168115-172.31.14.131-1676494912182 (Datanode Uuid 261559dc-dd81-430e-bc23-90511c945d13) service to localhost/127.0.0.1:41347 2023-02-15 21:01:56,558 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/dfs/data/data3/current/BP-492168115-172.31.14.131-1676494912182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:56,558 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/dfs/data/data4/current/BP-492168115-172.31.14.131-1676494912182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:56,559 WARN [Listener at localhost/36693] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:01:56,562 INFO [Listener at localhost/36693] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:56,668 WARN [BP-492168115-172.31.14.131-1676494912182 heartbeating to localhost/127.0.0.1:41347] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:01:56,668 WARN [BP-492168115-172.31.14.131-1676494912182 heartbeating to localhost/127.0.0.1:41347] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-492168115-172.31.14.131-1676494912182 (Datanode Uuid 75620640-c0bf-4197-ade5-68d8f749c8a2) service to localhost/127.0.0.1:41347 2023-02-15 21:01:56,669 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/dfs/data/data1/current/BP-492168115-172.31.14.131-1676494912182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:56,669 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/cluster_859b3f4c-e207-fb8f-d431-0c39996d4f70/dfs/data/data2/current/BP-492168115-172.31.14.131-1676494912182] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:01:56,680 INFO [Listener at localhost/36693] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:01:56,797 INFO [Listener at localhost/36693] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:01:56,816 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:01:56,828 INFO [Listener at localhost/36693] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 256) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36693 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:41347 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41347 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41347 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41347 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40313,1676494912859)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:41347 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=577 (was 655), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 276), ProcessCount=166 (was 166), AvailableMemoryMB=2674 (was 2703) 2023-02-15 21:01:56,838 INFO [Listener at localhost/36693] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=166, AvailableMemoryMB=2673 2023-02-15 21:01:56,848 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/hadoop.log.dir so I do NOT create it in target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5 2023-02-15 21:01:56,848 WARN [Listener at localhost/36693] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/hadoop.log.dir Erasing configuration value by system value. 2023-02-15 21:01:56,848 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/hadoop.tmp.dir so I do NOT create it in target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5 2023-02-15 21:01:56,848 WARN [Listener at localhost/36693] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/266d748c-7de4-0ace-3df9-8cd78e2a1969/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-15 21:01:56,849 DEBUG [Listener at localhost/36693] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27, deleteOnExit=true 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/test.cache.data in system properties and HBase conf 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/hadoop.tmp.dir in system properties and HBase conf 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/hadoop.log.dir in system properties and HBase conf 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-15 21:01:56,849 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-15 21:01:56,850 DEBUG [Listener at localhost/36693] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:56,850 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-15 21:01:56,851 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/nfs.dump.dir in system properties and HBase conf 2023-02-15 21:01:56,851 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/java.io.tmpdir in system properties and HBase conf 2023-02-15 21:01:56,851 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-15 21:01:56,851 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-15 21:01:56,851 INFO [Listener at localhost/36693] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-15 21:01:56,855 WARN [Listener at localhost/36693] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:56,855 WARN [Listener at localhost/36693] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:56,900 WARN [Listener at localhost/36693] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:56,902 INFO [Listener at localhost/36693] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:56,906 INFO [Listener at localhost/36693] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/java.io.tmpdir/Jetty_localhost_33889_hdfs____k94dqb/webapp 2023-02-15 21:01:56,996 INFO [Listener at localhost/36693] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33889 2023-02-15 21:01:57,001 WARN [Listener at localhost/36693] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-15 21:01:57,001 WARN [Listener at localhost/36693] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-15 21:01:57,042 WARN [Listener at localhost/44151] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:57,055 WARN [Listener at localhost/44151] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:57,057 WARN [Listener at localhost/44151] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:57,058 INFO [Listener at localhost/44151] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:57,064 INFO [Listener at localhost/44151] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/java.io.tmpdir/Jetty_localhost_42097_datanode____t3kmpj/webapp 2023-02-15 21:01:57,155 INFO [Listener at localhost/44151] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42097 2023-02-15 21:01:57,165 WARN [Listener at localhost/37247] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:57,179 WARN [Listener at localhost/37247] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-15 21:01:57,181 WARN [Listener at localhost/37247] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-15 21:01:57,182 INFO [Listener at localhost/37247] log.Slf4jLog(67): jetty-6.1.26 2023-02-15 21:01:57,186 INFO [Listener at localhost/37247] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/java.io.tmpdir/Jetty_localhost_45753_datanode____i1zgm3/webapp 2023-02-15 21:01:57,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2fdc58746fb90381: Processing first storage report for DS-43366599-e3b5-40bf-96ff-e572246353bd from datanode 1c06ef92-7dee-4ce1-bc04-1ca43711332c 2023-02-15 21:01:57,262 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2fdc58746fb90381: from storage DS-43366599-e3b5-40bf-96ff-e572246353bd node DatanodeRegistration(127.0.0.1:45547, datanodeUuid=1c06ef92-7dee-4ce1-bc04-1ca43711332c, infoPort=43827, infoSecurePort=0, ipcPort=37247, storageInfo=lv=-57;cid=testClusterID;nsid=1486292203;c=1676494916857), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:57,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2fdc58746fb90381: Processing first storage report for DS-2140baab-9e62-4faf-be1e-8a054f92bcc0 from datanode 1c06ef92-7dee-4ce1-bc04-1ca43711332c 2023-02-15 21:01:57,262 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2fdc58746fb90381: from storage DS-2140baab-9e62-4faf-be1e-8a054f92bcc0 node DatanodeRegistration(127.0.0.1:45547, datanodeUuid=1c06ef92-7dee-4ce1-bc04-1ca43711332c, infoPort=43827, infoSecurePort=0, ipcPort=37247, storageInfo=lv=-57;cid=testClusterID;nsid=1486292203;c=1676494916857), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:57,283 INFO [Listener at localhost/37247] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45753 2023-02-15 21:01:57,291 WARN [Listener at localhost/40849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-15 21:01:57,399 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa73a9b2045951335: Processing first storage report for DS-8033179f-e8bc-4c4c-8d74-00625d99a105 from datanode cf6d5573-78c8-452a-bd0f-8dfcd43aede8 2023-02-15 21:01:57,400 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa73a9b2045951335: from storage DS-8033179f-e8bc-4c4c-8d74-00625d99a105 node DatanodeRegistration(127.0.0.1:43507, datanodeUuid=cf6d5573-78c8-452a-bd0f-8dfcd43aede8, infoPort=40183, infoSecurePort=0, ipcPort=40849, storageInfo=lv=-57;cid=testClusterID;nsid=1486292203;c=1676494916857), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-15 21:01:57,400 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa73a9b2045951335: Processing first storage report for DS-b13b8411-aec6-493c-ae48-bc1219871055 from datanode cf6d5573-78c8-452a-bd0f-8dfcd43aede8 2023-02-15 21:01:57,400 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa73a9b2045951335: from storage DS-b13b8411-aec6-493c-ae48-bc1219871055 node DatanodeRegistration(127.0.0.1:43507, datanodeUuid=cf6d5573-78c8-452a-bd0f-8dfcd43aede8, infoPort=40183, infoSecurePort=0, ipcPort=40849, storageInfo=lv=-57;cid=testClusterID;nsid=1486292203;c=1676494916857), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-15 21:01:57,500 DEBUG [Listener at localhost/40849] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5 2023-02-15 21:01:57,502 INFO [Listener at localhost/40849] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/zookeeper_0, clientPort=64256, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-15 21:01:57,503 INFO [Listener at localhost/40849] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64256 2023-02-15 21:01:57,503 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,504 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,515 INFO [Listener at localhost/40849] util.FSUtils(479): Created version file at hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42 with version=8 2023-02-15 21:01:57,515 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,516 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,517 INFO [Listener at localhost/40849] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/hbase-staging 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:57,519 INFO [Listener at localhost/40849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:57,520 INFO [Listener at localhost/40849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40417 2023-02-15 21:01:57,520 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,521 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,521 INFO [Listener at localhost/40849] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40417 connecting to ZooKeeper ensemble=127.0.0.1:64256 2023-02-15 21:01:57,527 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:404170x0, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:57,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40417-0x10059ca39420000 connected 2023-02-15 21:01:57,543 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:57,544 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:57,544 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:57,544 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40417 2023-02-15 21:01:57,548 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40417 2023-02-15 21:01:57,548 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40417 2023-02-15 21:01:57,548 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40417 2023-02-15 21:01:57,548 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40417 2023-02-15 21:01:57,549 INFO [Listener at localhost/40849] master.HMaster(444): hbase.rootdir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42, hbase.cluster.distributed=false 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:57,563 INFO [Listener at localhost/40849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:57,564 INFO [Listener at localhost/40849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38137 2023-02-15 21:01:57,564 INFO [Listener at localhost/40849] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:57,565 DEBUG [Listener at localhost/40849] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:57,565 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,566 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,566 INFO [Listener at localhost/40849] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38137 connecting to ZooKeeper ensemble=127.0.0.1:64256 2023-02-15 21:01:57,569 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:381370x0, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:57,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38137-0x10059ca39420001 connected 2023-02-15 21:01:57,571 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:57,572 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:57,573 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:57,573 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38137 2023-02-15 21:01:57,573 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38137 2023-02-15 21:01:57,574 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38137 2023-02-15 21:01:57,576 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38137 2023-02-15 21:01:57,576 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38137 2023-02-15 21:01:57,586 INFO [Listener at localhost/40849] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-15 21:01:57,586 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,586 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,586 INFO [Listener at localhost/40849] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-15 21:01:57,586 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-15 21:01:57,587 INFO [Listener at localhost/40849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-15 21:01:57,587 INFO [Listener at localhost/40849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-15 21:01:57,588 INFO [Listener at localhost/40849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35237 2023-02-15 21:01:57,588 INFO [Listener at localhost/40849] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-15 21:01:57,589 DEBUG [Listener at localhost/40849] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:01:57,589 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,590 INFO [Listener at localhost/40849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,590 INFO [Listener at localhost/40849] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35237 connecting to ZooKeeper ensemble=127.0.0.1:64256 2023-02-15 21:01:57,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:352370x0, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-15 21:01:57,593 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): regionserver:352370x0, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:01:57,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35237-0x10059ca39420002 connected 2023-02-15 21:01:57,594 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:01:57,594 DEBUG [Listener at localhost/40849] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-15 21:01:57,596 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35237 2023-02-15 21:01:57,599 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35237 2023-02-15 21:01:57,599 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35237 2023-02-15 21:01:57,599 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35237 2023-02-15 21:01:57,599 DEBUG [Listener at localhost/40849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35237 2023-02-15 21:01:57,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,604 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:57,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,606 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:57,606 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:57,606 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,606 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-15 21:01:57,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:57,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-15 21:01:57,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40417,1676494917518 from backup master directory 2023-02-15 21:01:57,610 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,610 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-15 21:01:57,610 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:57,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/hbase.id with ID: e56d550f-a14c-47a0-8e57-459b6ec14b80 2023-02-15 21:01:57,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-15 21:01:57,633 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2a025029 to 127.0.0.1:64256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:57,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dad0c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:57,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:57,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-15 21:01:57,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:57,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store-tmp 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:01:57,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:57,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:57,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/WALs/jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40417%2C1676494917518, suffix=, logDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/WALs/jenkins-hbase4.apache.org,40417,1676494917518, archiveDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/oldWALs, maxLogs=10 2023-02-15 21:01:57,677 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK] 2023-02-15 21:01:57,678 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK] 2023-02-15 21:01:57,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/WALs/jenkins-hbase4.apache.org,40417,1676494917518/jenkins-hbase4.apache.org%2C40417%2C1676494917518.1676494917660 2023-02-15 21:01:57,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK]] 2023-02-15 21:01:57,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:57,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:57,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:57,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:57,683 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:57,684 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-15 21:01:57,685 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-15 21:01:57,685 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:57,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:57,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:57,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-15 21:01:57,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:57,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62897876, jitterRate=-0.06274861097335815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:57,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:01:57,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-15 21:01:57,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-15 21:01:57,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-15 21:01:57,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-15 21:01:57,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-15 21:01:57,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-15 21:01:57,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-15 21:01:57,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-15 21:01:57,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-15 21:01:57,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-15 21:01:57,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-15 21:01:57,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-15 21:01:57,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-15 21:01:57,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-15 21:01:57,708 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-15 21:01:57,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-15 21:01:57,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-15 21:01:57,711 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:57,711 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:57,711 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-15 21:01:57,711 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40417,1676494917518, sessionid=0x10059ca39420000, setting cluster-up flag (Was=false) 2023-02-15 21:01:57,716 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-15 21:01:57,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,724 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-15 21:01:57,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:57,728 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.hbase-snapshot/.tmp 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:57,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676494947732 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-15 21:01:57,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-15 21:01:57,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,751 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:57,751 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-15 21:01:57,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-15 21:01:57,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-15 21:01:57,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-15 21:01:57,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-15 21:01:57,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-15 21:01:57,753 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:57,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494917752,5,FailOnTimeoutGroup] 2023-02-15 21:01:57,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494917758,5,FailOnTimeoutGroup] 2023-02-15 21:01:57,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-15 21:01:57,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,764 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:57,764 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:57,764 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42 2023-02-15 21:01:57,772 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:57,773 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:57,774 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/info 2023-02-15 21:01:57,774 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:57,774 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:57,774 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:57,775 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:57,775 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:57,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:57,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:57,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/table 2023-02-15 21:01:57,777 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:57,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:57,778 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740 2023-02-15 21:01:57,778 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740 2023-02-15 21:01:57,779 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:57,780 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:57,781 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:57,782 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72373281, jitterRate=0.0784459263086319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:57,782 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:57,782 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:01:57,782 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:01:57,782 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:01:57,782 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:01:57,782 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:01:57,782 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:01:57,782 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:01:57,783 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-15 21:01:57,783 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-15 21:01:57,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-15 21:01:57,784 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-15 21:01:57,785 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-15 21:01:57,801 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(952): ClusterId : e56d550f-a14c-47a0-8e57-459b6ec14b80 2023-02-15 21:01:57,801 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(952): ClusterId : e56d550f-a14c-47a0-8e57-459b6ec14b80 2023-02-15 21:01:57,801 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:57,801 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-15 21:01:57,803 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:57,803 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-15 21:01:57,803 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:57,803 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-15 21:01:57,804 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:57,805 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-15 21:01:57,806 DEBUG [RS:0;jenkins-hbase4:38137] zookeeper.ReadOnlyZKClient(139): Connect 0x23eadaab to 127.0.0.1:64256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:57,806 DEBUG [RS:1;jenkins-hbase4:35237] zookeeper.ReadOnlyZKClient(139): Connect 0x15431cfb to 127.0.0.1:64256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:57,810 DEBUG [RS:0;jenkins-hbase4:38137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d2d20a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:57,810 DEBUG [RS:1;jenkins-hbase4:35237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b84f023, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:57,810 DEBUG [RS:0;jenkins-hbase4:38137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2912b1db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:57,810 DEBUG [RS:1;jenkins-hbase4:35237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbb778b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:01:57,823 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35237 2023-02-15 21:01:57,823 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38137 2023-02-15 21:01:57,823 INFO [RS:1;jenkins-hbase4:35237] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:57,823 INFO [RS:1;jenkins-hbase4:35237] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:57,823 INFO [RS:0;jenkins-hbase4:38137] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-15 21:01:57,823 INFO [RS:0;jenkins-hbase4:38137] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-15 21:01:57,823 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:57,823 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1023): About to register with Master. 2023-02-15 21:01:57,824 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40417,1676494917518 with isa=jenkins-hbase4.apache.org/172.31.14.131:35237, startcode=1676494917586 2023-02-15 21:01:57,824 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40417,1676494917518 with isa=jenkins-hbase4.apache.org/172.31.14.131:38137, startcode=1676494917562 2023-02-15 21:01:57,824 DEBUG [RS:1;jenkins-hbase4:35237] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:57,824 DEBUG [RS:0;jenkins-hbase4:38137] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-15 21:01:57,825 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36737, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:57,825 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37887, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-15 21:01:57,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40417] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,827 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,828 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42 2023-02-15 21:01:57,828 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44151 2023-02-15 21:01:57,828 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:57,828 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42 2023-02-15 21:01:57,828 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44151 2023-02-15 21:01:57,828 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-15 21:01:57,829 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:01:57,832 DEBUG [RS:1;jenkins-hbase4:35237] zookeeper.ZKUtil(162): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,832 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38137,1676494917562] 2023-02-15 21:01:57,833 WARN [RS:1;jenkins-hbase4:35237] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:57,833 DEBUG [RS:0;jenkins-hbase4:38137] zookeeper.ZKUtil(162): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,833 INFO [RS:1;jenkins-hbase4:35237] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:57,833 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35237,1676494917586] 2023-02-15 21:01:57,833 WARN [RS:0;jenkins-hbase4:38137] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-15 21:01:57,833 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,833 INFO [RS:0;jenkins-hbase4:38137] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:57,833 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,841 DEBUG [RS:0;jenkins-hbase4:38137] zookeeper.ZKUtil(162): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,841 DEBUG [RS:1;jenkins-hbase4:35237] zookeeper.ZKUtil(162): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,841 DEBUG [RS:0;jenkins-hbase4:38137] zookeeper.ZKUtil(162): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,842 DEBUG [RS:1;jenkins-hbase4:35237] zookeeper.ZKUtil(162): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,842 DEBUG [RS:0;jenkins-hbase4:38137] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:57,842 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-15 21:01:57,842 INFO [RS:0;jenkins-hbase4:38137] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:57,842 INFO [RS:1;jenkins-hbase4:35237] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-15 21:01:57,843 INFO [RS:0;jenkins-hbase4:38137] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:57,844 INFO [RS:0;jenkins-hbase4:38137] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:57,844 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,848 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:57,848 INFO [RS:1;jenkins-hbase4:35237] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-15 21:01:57,850 INFO [RS:1;jenkins-hbase4:35237] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-15 21:01:57,850 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,851 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-15 21:01:57,851 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,852 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,852 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,852 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,852 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,852 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:57,853 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,853 DEBUG [RS:0;jenkins-hbase4:38137] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,853 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-15 21:01:57,854 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,854 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,854 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,854 DEBUG [RS:1;jenkins-hbase4:35237] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-15 21:01:57,856 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,856 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,856 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,857 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,857 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,857 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,867 INFO [RS:0;jenkins-hbase4:38137] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:57,868 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38137,1676494917562-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,870 INFO [RS:1;jenkins-hbase4:35237] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-15 21:01:57,870 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35237,1676494917586-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:57,880 INFO [RS:1;jenkins-hbase4:35237] regionserver.Replication(203): jenkins-hbase4.apache.org,35237,1676494917586 started 2023-02-15 21:01:57,881 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35237,1676494917586, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35237, sessionid=0x10059ca39420002 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35237,1676494917586' 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35237,1676494917586' 2023-02-15 21:01:57,881 DEBUG [RS:1;jenkins-hbase4:35237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:57,882 DEBUG [RS:1;jenkins-hbase4:35237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:57,882 DEBUG [RS:1;jenkins-hbase4:35237] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:57,882 INFO [RS:1;jenkins-hbase4:35237] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:57,882 INFO [RS:1;jenkins-hbase4:35237] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:57,886 INFO [RS:0;jenkins-hbase4:38137] regionserver.Replication(203): jenkins-hbase4.apache.org,38137,1676494917562 started 2023-02-15 21:01:57,886 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38137,1676494917562, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38137, sessionid=0x10059ca39420001 2023-02-15 21:01:57,886 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-15 21:01:57,886 DEBUG [RS:0;jenkins-hbase4:38137] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,886 DEBUG [RS:0;jenkins-hbase4:38137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38137,1676494917562' 2023-02-15 21:01:57,886 DEBUG [RS:0;jenkins-hbase4:38137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:57,886 DEBUG [RS:0;jenkins-hbase4:38137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:57,886 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-15 21:01:57,887 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-15 21:01:57,887 DEBUG [RS:0;jenkins-hbase4:38137] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:57,887 DEBUG [RS:0;jenkins-hbase4:38137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38137,1676494917562' 2023-02-15 21:01:57,887 DEBUG [RS:0;jenkins-hbase4:38137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:57,887 DEBUG [RS:0;jenkins-hbase4:38137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:57,887 DEBUG [RS:0;jenkins-hbase4:38137] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-15 21:01:57,887 INFO [RS:0;jenkins-hbase4:38137] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-15 21:01:57,887 INFO [RS:0;jenkins-hbase4:38137] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-15 21:01:57,936 DEBUG [jenkins-hbase4:40417] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-15 21:01:57,936 DEBUG [jenkins-hbase4:40417] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:57,937 DEBUG [jenkins-hbase4:40417] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:57,937 DEBUG [jenkins-hbase4:40417] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:57,937 DEBUG [jenkins-hbase4:40417] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:57,937 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35237,1676494917586, state=OPENING 2023-02-15 21:01:57,940 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-15 21:01:57,941 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:57,941 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:57,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35237,1676494917586}] 2023-02-15 21:01:58,096 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:58,096 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-15 21:01:58,098 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-15 21:01:58,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-15 21:01:58,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-15 21:01:58,147 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35237%2C1676494917586.meta, suffix=.meta, logDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,35237,1676494917586, archiveDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/oldWALs, maxLogs=32 2023-02-15 21:01:58,167 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK] 2023-02-15 21:01:58,167 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK] 2023-02-15 21:01:58,169 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,35237,1676494917586/jenkins-hbase4.apache.org%2C35237%2C1676494917586.meta.1676494918151.meta 2023-02-15 21:01:58,169 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK]] 2023-02-15 21:01:58,169 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:58,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-15 21:01:58,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-15 21:01:58,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-15 21:01:58,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-15 21:01:58,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:58,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-15 21:01:58,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-15 21:01:58,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-15 21:01:58,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/info 2023-02-15 21:01:58,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/info 2023-02-15 21:01:58,172 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-15 21:01:58,172 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:58,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-15 21:01:58,173 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:58,173 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/rep_barrier 2023-02-15 21:01:58,173 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-15 21:01:58,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:58,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-15 21:01:58,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/table 2023-02-15 21:01:58,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/table 2023-02-15 21:01:58,175 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-15 21:01:58,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:58,175 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740 2023-02-15 21:01:58,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740 2023-02-15 21:01:58,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-15 21:01:58,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-15 21:01:58,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72354818, jitterRate=0.07817080616950989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-15 21:01:58,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-15 21:01:58,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676494918096 2023-02-15 21:01:58,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-15 21:01:58,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-15 21:01:58,184 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35237,1676494917586, state=OPEN 2023-02-15 21:01:58,185 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-15 21:01:58,186 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-15 21:01:58,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-15 21:01:58,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35237,1676494917586 in 244 msec 2023-02-15 21:01:58,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-15 21:01:58,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 404 msec 2023-02-15 21:01:58,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 459 msec 2023-02-15 21:01:58,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676494918189, completionTime=-1 2023-02-15 21:01:58,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-15 21:01:58,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-15 21:01:58,191 DEBUG [hconnection-0x4f089a28-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:58,193 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:58,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-15 21:01:58,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676494978194 2023-02-15 21:01:58,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676495038194 2023-02-15 21:01:58,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40417,1676494917518-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40417,1676494917518-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40417,1676494917518-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40417, period=300000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-15 21:01:58,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:58,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-15 21:01:58,200 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-15 21:01:58,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:58,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:58,202 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,203 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1 empty. 2023-02-15 21:01:58,203 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-15 21:01:58,211 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:58,211 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77e8c157e55577ddac1772545891e1a1, NAME => 'hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp 2023-02-15 21:01:58,217 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:58,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 77e8c157e55577ddac1772545891e1a1, disabling compactions & flushes 2023-02-15 21:01:58,218 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. after waiting 0 ms 2023-02-15 21:01:58,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,218 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,218 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 77e8c157e55577ddac1772545891e1a1: 2023-02-15 21:01:58,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:58,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494918220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494918220"}]},"ts":"1676494918220"} 2023-02-15 21:01:58,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:58,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:58,222 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494918222"}]},"ts":"1676494918222"} 2023-02-15 21:01:58,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-15 21:01:58,225 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:58,226 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:58,226 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:58,226 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:58,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=77e8c157e55577ddac1772545891e1a1, ASSIGN}] 2023-02-15 21:01:58,228 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=77e8c157e55577ddac1772545891e1a1, ASSIGN 2023-02-15 21:01:58,229 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=77e8c157e55577ddac1772545891e1a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35237,1676494917586; forceNewPlan=false, retain=false 2023-02-15 21:01:58,379 INFO [jenkins-hbase4:40417] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:58,379 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=77e8c157e55577ddac1772545891e1a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:58,380 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494918379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494918379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494918379"}]},"ts":"1676494918379"} 2023-02-15 21:01:58,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 77e8c157e55577ddac1772545891e1a1, server=jenkins-hbase4.apache.org,35237,1676494917586}] 2023-02-15 21:01:58,535 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35237%2C1676494917586, suffix=, logDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,35237,1676494917586, archiveDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/oldWALs, maxLogs=32 2023-02-15 21:01:58,549 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK] 2023-02-15 21:01:58,549 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK] 2023-02-15 21:01:58,551 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,35237,1676494917586/jenkins-hbase4.apache.org%2C35237%2C1676494917586.1676494918537 2023-02-15 21:01:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK], DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK]] 2023-02-15 21:01:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77e8c157e55577ddac1772545891e1a1, NAME => 'hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,552 INFO [StoreOpener-77e8c157e55577ddac1772545891e1a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,553 DEBUG [StoreOpener-77e8c157e55577ddac1772545891e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/info 2023-02-15 21:01:58,553 DEBUG [StoreOpener-77e8c157e55577ddac1772545891e1a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/info 2023-02-15 21:01:58,553 INFO [StoreOpener-77e8c157e55577ddac1772545891e1a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77e8c157e55577ddac1772545891e1a1 columnFamilyName info 2023-02-15 21:01:58,554 INFO [StoreOpener-77e8c157e55577ddac1772545891e1a1-1] regionserver.HStore(310): Store=77e8c157e55577ddac1772545891e1a1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:58,554 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:01:58,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:58,558 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 77e8c157e55577ddac1772545891e1a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69781252, jitterRate=0.03982168436050415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-15 21:01:58,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 77e8c157e55577ddac1772545891e1a1: 2023-02-15 21:01:58,558 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1., pid=6, masterSystemTime=1676494918532 2023-02-15 21:01:58,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,561 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:01:58,561 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=77e8c157e55577ddac1772545891e1a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:58,561 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676494918561"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494918561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494918561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494918561"}]},"ts":"1676494918561"} 2023-02-15 21:01:58,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-15 21:01:58,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 77e8c157e55577ddac1772545891e1a1, server=jenkins-hbase4.apache.org,35237,1676494917586 in 181 msec 2023-02-15 21:01:58,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-15 21:01:58,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=77e8c157e55577ddac1772545891e1a1, ASSIGN in 337 msec 2023-02-15 21:01:58,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:58,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494918565"}]},"ts":"1676494918565"} 2023-02-15 21:01:58,566 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-15 21:01:58,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:58,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 369 msec 2023-02-15 21:01:58,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-15 21:01:58,603 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:58,603 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:01:58,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-15 21:01:58,612 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:58,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 7 msec 2023-02-15 21:01:58,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-15 21:01:58,623 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-15 21:01:58,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-15 21:01:58,634 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-15 21:01:58,637 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-15 21:01:58,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.027sec 2023-02-15 21:01:58,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-15 21:01:58,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-15 21:01:58,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-15 21:01:58,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40417,1676494917518-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-15 21:01:58,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40417,1676494917518-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-15 21:01:58,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-15 21:01:58,702 DEBUG [Listener at localhost/40849] zookeeper.ReadOnlyZKClient(139): Connect 0x15c0aa4d to 127.0.0.1:64256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:58,704 DEBUG [Listener at localhost/40849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@554765bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:58,706 DEBUG [hconnection-0xfb5e2bb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:58,707 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50124, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:58,708 INFO [Listener at localhost/40849] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:01:58,708 DEBUG [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-15 21:01:58,711 DEBUG [Listener at localhost/40849] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-15 21:01:58,712 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37390, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-15 21:01:58,712 INFO [Listener at localhost/40849] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 21:01:58,713 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 21:01:58,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-15 21:01:58,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:37390 deadline: 1676494978713, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-15 21:01:58,713 INFO [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-15 21:01:58,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-15 21:01:58,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-15 21:01:58,718 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-15 21:01:58,718 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-15 21:01:58,718 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-15 21:01:58,720 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:58,720 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 empty. 2023-02-15 21:01:58,720 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:58,720 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 21:01:58,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:58,729 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-15 21:01:58,729 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c03ac4df26a22cc3426c9d536cba9361, NAME => 'testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp 2023-02-15 21:01:58,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:58,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c03ac4df26a22cc3426c9d536cba9361, disabling compactions & flushes 2023-02-15 21:01:58,734 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:58,734 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:58,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. after waiting 0 ms 2023-02-15 21:01:58,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:58,735 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:58,735 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:01:58,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-15 21:01:58,737 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676494918737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494918737"}]},"ts":"1676494918737"} 2023-02-15 21:01:58,738 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-15 21:01:58,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-15 21:01:58,739 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494918739"}]},"ts":"1676494918739"} 2023-02-15 21:01:58,740 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-15 21:01:58,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-15 21:01:58,743 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-15 21:01:58,743 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-15 21:01:58,743 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-15 21:01:58,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, ASSIGN}] 2023-02-15 21:01:58,747 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, ASSIGN 2023-02-15 21:01:58,747 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35237,1676494917586; forceNewPlan=false, retain=false 2023-02-15 21:01:58,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:58,889 INFO [RS:0;jenkins-hbase4:38137] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38137%2C1676494917562, suffix=, logDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,38137,1676494917562, archiveDir=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/oldWALs, maxLogs=32 2023-02-15 21:01:58,898 INFO [jenkins-hbase4:40417] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-15 21:01:58,898 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c03ac4df26a22cc3426c9d536cba9361, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:58,898 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676494918898"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494918898"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494918898"}]},"ts":"1676494918898"} 2023-02-15 21:01:58,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure c03ac4df26a22cc3426c9d536cba9361, server=jenkins-hbase4.apache.org,35237,1676494917586}] 2023-02-15 21:01:58,909 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK] 2023-02-15 21:01:58,909 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK] 2023-02-15 21:01:58,910 INFO [RS:0;jenkins-hbase4:38137] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/WALs/jenkins-hbase4.apache.org,38137,1676494917562/jenkins-hbase4.apache.org%2C38137%2C1676494917562.1676494918889 2023-02-15 21:01:58,910 DEBUG [RS:0;jenkins-hbase4:38137] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45547,DS-43366599-e3b5-40bf-96ff-e572246353bd,DISK], DatanodeInfoWithStorage[127.0.0.1:43507,DS-8033179f-e8bc-4c4c-8d74-00625d99a105,DISK]] 2023-02-15 21:01:59,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:59,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c03ac4df26a22cc3426c9d536cba9361, NAME => 'testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.', STARTKEY => '', ENDKEY => ''} 2023-02-15 21:01:59,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:01:59,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,055 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,056 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1 2023-02-15 21:01:59,056 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1 2023-02-15 21:01:59,056 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03ac4df26a22cc3426c9d536cba9361 columnFamilyName f1 2023-02-15 21:01:59,057 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(310): Store=c03ac4df26a22cc3426c9d536cba9361/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:59,057 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,058 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2 2023-02-15 21:01:59,058 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2 2023-02-15 21:01:59,058 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03ac4df26a22cc3426c9d536cba9361 columnFamilyName f2 2023-02-15 21:01:59,058 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(310): Store=c03ac4df26a22cc3426c9d536cba9361/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:01:59,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:01:59,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:01:59,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-15 21:01:59,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c03ac4df26a22cc3426c9d536cba9361; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70232557, jitterRate=0.04654665291309357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:01:59,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:01:59,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361., pid=12, masterSystemTime=1676494919051 2023-02-15 21:01:59,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,065 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c03ac4df26a22cc3426c9d536cba9361, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676494919065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676494919065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676494919065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676494919065"}]},"ts":"1676494919065"} 2023-02-15 21:01:59,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-15 21:01:59,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure c03ac4df26a22cc3426c9d536cba9361, server=jenkins-hbase4.apache.org,35237,1676494917586 in 167 msec 2023-02-15 21:01:59,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-15 21:01:59,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, ASSIGN in 324 msec 2023-02-15 21:01:59,069 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-15 21:01:59,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494919069"}]},"ts":"1676494919069"} 2023-02-15 21:01:59,070 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-15 21:01:59,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-15 21:01:59,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 357 msec 2023-02-15 21:01:59,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-15 21:01:59,326 INFO [Listener at localhost/40849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-15 21:01:59,326 DEBUG [Listener at localhost/40849] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-15 21:01:59,326 INFO [Listener at localhost/40849] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:59,328 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-15 21:01:59,328 INFO [Listener at localhost/40849] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-15 21:01:59,328 INFO [Listener at localhost/40849] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-15 21:01:59,328 INFO [Listener at localhost/40849] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-15 21:01:59,328 INFO [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-15 21:01:59,371 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35237] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,484 INFO [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-15 21:01:59,484 INFO [Listener at localhost/40849] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-15 21:01:59,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:59,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676494919485 (current time:1676494919485). 2023-02-15 21:01:59,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-15 21:01:59,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] zookeeper.ReadOnlyZKClient(139): Connect 0x617747fb to 127.0.0.1:64256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-15 21:01:59,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@83f2bdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-15 21:01:59,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-15 21:01:59,491 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50140, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-15 21:01:59,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x617747fb to 127.0.0.1:64256 2023-02-15 21:01:59,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:01:59,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-15 21:01:59,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:59,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:59,496 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:59,496 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676495519496 2023-02-15 21:01:59,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-15 21:01:59,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-15 21:01:59,498 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-15 21:01:59,498 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-15 21:01:59,498 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-15 21:01:59,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:59,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-15 21:01:59,499 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:59,500 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676495519500 2023-02-15 21:01:59,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-15 21:01:59,512 INFO [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-15 21:01:59,512 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:59,513 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-15 21:01:59,513 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-15 21:01:59,513 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,513 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,514 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,514 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:59,514 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:59,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:59,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:59,515 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,515 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-15 21:01:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,516 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 21:01:59,516 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-15 21:01:59,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 21:01:59,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-15 21:01:59,516 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 21:01:59,516 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:59,516 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-15 21:01:59,517 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 21:01:59,517 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 21:01:59,517 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-15 21:01:59,517 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35237,1676494917586' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 21:01:59,520 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-15 21:01:59,520 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-15 21:01:59,520 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38137,1676494917562' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-15 21:01:59,525 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,525 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:59,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:59,525 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,525 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,525 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:59,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:59,525 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,525 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 21:01:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:59,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35237,1676494917586' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-15 21:01:59,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b3cbb28[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:59,527 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-15 21:01:59,527 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,528 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 21:01:59,528 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-15 21:01:59,528 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 21:01:59,528 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,528 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-15 21:01:59,528 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38137,1676494917562' in zk 2023-02-15 21:01:59,528 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-15 21:01:59,528 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:59,528 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,528 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. started... 2023-02-15 21:01:59,528 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c03ac4df26a22cc3426c9d536cba9361 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-15 21:01:59,529 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 21:01:59,529 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:59,529 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 21:01:59,541 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f1/d2b87be29def4a898fb46cb25eb78f3f 2023-02-15 21:01:59,556 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f2/bc2d11b846954f89875a3c69591a7507 2023-02-15 21:01:59,560 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f1/d2b87be29def4a898fb46cb25eb78f3f as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/d2b87be29def4a898fb46cb25eb78f3f 2023-02-15 21:01:59,563 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/d2b87be29def4a898fb46cb25eb78f3f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:59,564 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f2/bc2d11b846954f89875a3c69591a7507 as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/bc2d11b846954f89875a3c69591a7507 2023-02-15 21:01:59,567 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/bc2d11b846954f89875a3c69591a7507, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-15 21:01:59,568 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for c03ac4df26a22cc3426c9d536cba9361 in 40ms, sequenceid=5, compaction requested=false 2023-02-15 21:01:59,568 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:01:59,568 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-15 21:01:59,568 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-15 21:01:59,568 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/d2b87be29def4a898fb46cb25eb78f3f] hfiles 2023-02-15 21:01:59,569 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/d2b87be29def4a898fb46cb25eb78f3f for snapshot=testWithMapReduceSingleRegion 2023-02-15 21:01:59,569 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/bc2d11b846954f89875a3c69591a7507] hfiles 2023-02-15 21:01:59,569 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/bc2d11b846954f89875a3c69591a7507 for snapshot=testWithMapReduceSingleRegion 2023-02-15 21:01:59,575 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. completed. 2023-02-15 21:01:59,575 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-15 21:01:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-15 21:01:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-15 21:01:59,575 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,35237,1676494917586' in zk 2023-02-15 21:01:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-15 21:01:59,576 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,576 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:59,577 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-15 21:01:59,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:59,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:59,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:59,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 21:01:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:59,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 21:01:59,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,35237,1676494917586': 2023-02-15 21:01:59,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35237,1676494917586' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-15 21:01:59,580 INFO [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-15 21:01:59,580 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:59,580 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:59,580 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-15 21:01:59,580 INFO [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-15 21:01:59,585 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-15 21:01:59,585 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:59,585 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:59,585 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:59,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,586 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 21:01:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:59,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 21:01:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,587 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,587 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:59,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-15 21:01:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:59,592 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:59,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:59,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:59,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-15 21:01:59,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-15 21:01:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-15 21:01:59,592 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-15 21:01:59,593 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:59,593 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,593 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-15 21:01:59,593 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-15 21:01:59,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 21:01:59,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-15 21:01:59,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-15 21:01:59,598 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:59,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:59,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-15 21:01:59,599 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-15 21:01:59,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-15 21:01:59,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-15 21:01:59,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 21:01:59,631 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-15 21:01:59,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676494919497Consolidate snapshot: testWithMapReduceSingleRegion at 1676494919593 (+96 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676494919593Writing data manifest for testWithMapReduceSingleRegion at 1676494919595 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676494919602 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676494919631 (+29 ms) 2023-02-15 21:01:59,633 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-15 21:01:59,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 135 msec 2023-02-15 21:01:59,799 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-15 21:01:59,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-15 21:01:59,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-15 21:01:59,801 INFO [Listener at localhost/40849] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-15 21:01:59,804 INFO [Listener at localhost/40849] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-15 21:01:59,809 INFO [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-15 21:01:59,841 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35237] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,924 INFO [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-15 21:01:59,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-15 21:01:59,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-15 21:01:59,930 INFO [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-15 21:01:59,930 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:59,930 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-15 21:01:59,930 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-15 21:01:59,931 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,931 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:59,932 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:59,932 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:59,932 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:01:59,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:01:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:01:59,932 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,932 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-15 21:01:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-15 21:01:59,933 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 21:01:59,933 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38137,1676494917562' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-15 21:01:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-15 21:01:59,934 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,934 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. started... 2023-02-15 21:01:59,934 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c03ac4df26a22cc3426c9d536cba9361 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-15 21:01:59,936 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,936 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,936 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:59,949 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f1/01f28bb43b6244e9b1a22a7fcd734564 2023-02-15 21:01:59,967 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f2/4c337fa710694c38b66e73f57ddd6f78 2023-02-15 21:01:59,971 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f1/01f28bb43b6244e9b1a22a7fcd734564 as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/01f28bb43b6244e9b1a22a7fcd734564 2023-02-15 21:01:59,975 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/01f28bb43b6244e9b1a22a7fcd734564, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:59,976 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/.tmp/f2/4c337fa710694c38b66e73f57ddd6f78 as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/4c337fa710694c38b66e73f57ddd6f78 2023-02-15 21:01:59,983 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/4c337fa710694c38b66e73f57ddd6f78, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-15 21:01:59,984 INFO [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for c03ac4df26a22cc3426c9d536cba9361 in 50ms, sequenceid=9, compaction requested=false 2023-02-15 21:01:59,984 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:01:59,984 DEBUG [rs(jenkins-hbase4.apache.org,35237,1676494917586)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:01:59,984 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-15 21:01:59,984 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-15 21:01:59,984 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,984 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-15 21:01:59,984 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35237,1676494917586' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-15 21:01:59,986 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-15 21:01:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:59,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35237,1676494917586' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-15 21:01:59,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f033697[Count = 0] remaining members to acquire global barrier 2023-02-15 21:01:59,988 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-15 21:01:59,988 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:01:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 21:01:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-15 21:01:59,989 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,989 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-15 21:01:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 21:01:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-15 21:01:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38137,1676494917562' in zk 2023-02-15 21:01:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35237,1676494917586' in zk 2023-02-15 21:01:59,991 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 21:01:59,991 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-15 21:01:59,991 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,991 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,991 DEBUG [member: 'jenkins-hbase4.apache.org,35237,1676494917586' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 21:01:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:59,991 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:01:59,991 DEBUG [member: 'jenkins-hbase4.apache.org,38137,1676494917562' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-15 21:01:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35237,1676494917586': 2023-02-15 21:01:59,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35237,1676494917586' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-15 21:01:59,993 INFO [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-15 21:01:59,993 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-15 21:01:59,993 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-15 21:01:59,993 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-15 21:01:59,993 INFO [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-15 21:01:59,996 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-15 21:01:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-15 21:01:59,996 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:59,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:01:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-15 21:01:59,996 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:59,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,997 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-15 21:01:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,998 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-15 21:01:59,998 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:01:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-15 21:01:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:01:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-15 21:02:00,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:02:00,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-15 21:02:00,001 DEBUG [(jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:02:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:02:00,001 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-15 21:02:00,001 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-15 21:02:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-15 21:02:00,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:02:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:02:00,001 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-15 21:02:00,002 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-15 21:02:00,002 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-15 21:02:00,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-15 21:02:00,002 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-15 21:02:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-15 21:02:00,102 DEBUG [Listener at localhost/40849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-15 21:02:00,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-15 21:02:00,188 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/hadoop-5752344065335951243.jar 2023-02-15 21:02:00,192 INFO [Listener at localhost/40849] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676494919485 type: FLUSH version: 2 ttl: 0 2023-02-15 21:02:00,192 DEBUG [Listener at localhost/40849] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4/data/default/testWithMapReduce 2023-02-15 21:02:00,193 INFO [Listener at localhost/40849] snapshot.RestoreSnapshotHelper(239): region to add: c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:00,193 INFO [Listener at localhost/40849] snapshot.RestoreSnapshotHelper(585): clone region=c03ac4df26a22cc3426c9d536cba9361 as c03ac4df26a22cc3426c9d536cba9361 in snapshot testWithMapReduceSingleRegion 2023-02-15 21:02:00,193 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c03ac4df26a22cc3426c9d536cba9361, NAME => 'testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4 2023-02-15 21:02:00,199 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:02:00,199 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2b87be29def4a898fb46cb25eb78f3f from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 21:02:00,201 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc2d11b846954f89875a3c69591a7507 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-15 21:02:00,202 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c03ac4df26a22cc3426c9d536cba9361, disabling compactions & flushes 2023-02-15 21:02:00,202 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,202 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,202 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. after waiting 0 ms 2023-02-15 21:02:00,202 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,202 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,202 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:02:00,203 INFO [Listener at localhost/40849] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676494919485 type: FLUSH version: 2 ttl: 0 2023-02-15 21:02:00,203 DEBUG [Listener at localhost/40849] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4 2023-02-15 21:02:00,203 DEBUG [Listener at localhost/40849] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4 2023-02-15 21:02:00,203 DEBUG [Listener at localhost/40849] util.CommonFSUtils(699): |-data/ 2023-02-15 21:02:00,203 DEBUG [Listener at localhost/40849] util.CommonFSUtils(699): |----default/ 2023-02-15 21:02:00,204 DEBUG [Listener at localhost/40849] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-15 21:02:00,204 DEBUG [Listener at localhost/40849] util.CommonFSUtils(699): |----------c03ac4df26a22cc3426c9d536cba9361/ 2023-02-15 21:02:00,205 DEBUG [Listener at localhost/40849] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-15 21:02:00,205 DEBUG [Listener at localhost/40849] util.CommonFSUtils(699): |-------------f1/ 2023-02-15 21:02:00,205 DEBUG [Listener at localhost/40849] util.CommonFSUtils(702): |----------------testWithMapReduce=c03ac4df26a22cc3426c9d536cba9361-d2b87be29def4a898fb46cb25eb78f3f 2023-02-15 21:02:00,205 DEBUG [Listener at localhost/40849] util.CommonFSUtils(699): |-------------f2/ 2023-02-15 21:02:00,205 DEBUG [Listener at localhost/40849] util.CommonFSUtils(702): |----------------testWithMapReduce=c03ac4df26a22cc3426c9d536cba9361-bc2d11b846954f89875a3c69591a7507 2023-02-15 21:02:00,205 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,206 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,207 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,207 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,207 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,208 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,208 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,276 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/hadoop-7820092707731402739.jar 2023-02-15 21:02:00,277 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,277 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,277 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,277 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,278 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,278 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,278 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-15 21:02:00,279 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-15 21:02:00,279 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-15 21:02:00,279 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-15 21:02:00,280 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-15 21:02:00,280 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-15 21:02:00,280 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-15 21:02:00,281 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-15 21:02:00,281 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-15 21:02:00,282 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-15 21:02:00,282 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-15 21:02:00,282 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:02:00,283 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:02:00,283 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-15 21:02:00,283 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 21:02:00,349 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/hadoop-13488184602820837.jar 2023-02-15 21:02:00,349 DEBUG [Listener at localhost/40849] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-15 21:02:00,354 WARN [Listener at localhost/40849] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-15 21:02:00,384 INFO [Listener at localhost/40849] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-15 21:02:00,465 WARN [Listener at localhost/40849] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/mapreduce.cluster.local.dir/1676494920431/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-15 21:02:00,465 WARN [Listener at localhost/40849] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/mapreduce.cluster.local.dir/1676494920431/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-15 21:02:00,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-15 21:02:00,497 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-15 21:02:00,497 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-15 21:02:00,499 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:00,500 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1 2023-02-15 21:02:00,500 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03ac4df26a22cc3426c9d536cba9361 columnFamilyName f1 2023-02-15 21:02:00,504 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(539): loaded hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/testWithMapReduce=c03ac4df26a22cc3426c9d536cba9361-d2b87be29def4a898fb46cb25eb78f3f 2023-02-15 21:02:00,504 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(310): Store=c03ac4df26a22cc3426c9d536cba9361/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:02:00,504 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:00,505 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2 2023-02-15 21:02:00,505 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c03ac4df26a22cc3426c9d536cba9361 columnFamilyName f2 2023-02-15 21:02:00,509 DEBUG [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(539): loaded hdfs://localhost:44151/user/jenkins/test-data/8833636c-561e-fadb-3d0b-bb5763558d17/testWithMapReduceSingleRegion/711e6b88-2b5f-4655-93a3-c2769ee836a4/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/testWithMapReduce=c03ac4df26a22cc3426c9d536cba9361-bc2d11b846954f89875a3c69591a7507 2023-02-15 21:02:00,509 INFO [StoreOpener-c03ac4df26a22cc3426c9d536cba9361-1] regionserver.HStore(310): Store=c03ac4df26a22cc3426c9d536cba9361/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-15 21:02:00,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-15 21:02:00,509 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c03ac4df26a22cc3426c9d536cba9361; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72760433, jitterRate=0.0842149406671524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-15 21:02:00,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:02:00,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c03ac4df26a22cc3426c9d536cba9361, disabling compactions & flushes 2023-02-15 21:02:00,629 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. after waiting 0 ms 2023-02-15 21:02:00,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,630 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:00,630 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:02:01,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-15 21:02:01,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-15 21:02:01,503 INFO [Listener at localhost/40849] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-15 21:02:01,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-15 21:02:01,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:02:01,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494921506"}]},"ts":"1676494921506"} 2023-02-15 21:02:01,507 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-15 21:02:01,508 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-15 21:02:01,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, UNASSIGN}] 2023-02-15 21:02:01,509 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, UNASSIGN 2023-02-15 21:02:01,510 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c03ac4df26a22cc3426c9d536cba9361, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:02:01,510 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676494921510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676494921510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676494921510"}]},"ts":"1676494921510"} 2023-02-15 21:02:01,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure c03ac4df26a22cc3426c9d536cba9361, server=jenkins-hbase4.apache.org,35237,1676494917586}] 2023-02-15 21:02:01,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:02:01,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:01,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c03ac4df26a22cc3426c9d536cba9361, disabling compactions & flushes 2023-02-15 21:02:01,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:01,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:01,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. after waiting 0 ms 2023-02-15 21:02:01,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:01,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-15 21:02:01,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361. 2023-02-15 21:02:01,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c03ac4df26a22cc3426c9d536cba9361: 2023-02-15 21:02:01,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:01,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c03ac4df26a22cc3426c9d536cba9361, regionState=CLOSED 2023-02-15 21:02:01,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676494921670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676494921670"}]},"ts":"1676494921670"} 2023-02-15 21:02:01,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-15 21:02:01,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure c03ac4df26a22cc3426c9d536cba9361, server=jenkins-hbase4.apache.org,35237,1676494917586 in 160 msec 2023-02-15 21:02:01,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-15 21:02:01,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c03ac4df26a22cc3426c9d536cba9361, UNASSIGN in 163 msec 2023-02-15 21:02:01,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676494921673"}]},"ts":"1676494921673"} 2023-02-15 21:02:01,674 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-15 21:02:01,676 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-15 21:02:01,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 173 msec 2023-02-15 21:02:01,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-15 21:02:01,808 INFO [Listener at localhost/40849] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-15 21:02:01,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-15 21:02:01,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,811 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,812 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:02:01,815 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:01,816 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1, FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2, FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/recovered.edits] 2023-02-15 21:02:01,819 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/01f28bb43b6244e9b1a22a7fcd734564 to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/archive/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/01f28bb43b6244e9b1a22a7fcd734564 2023-02-15 21:02:01,820 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/d2b87be29def4a898fb46cb25eb78f3f to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/archive/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f1/d2b87be29def4a898fb46cb25eb78f3f 2023-02-15 21:02:01,822 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/4c337fa710694c38b66e73f57ddd6f78 to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/archive/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/4c337fa710694c38b66e73f57ddd6f78 2023-02-15 21:02:01,822 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/bc2d11b846954f89875a3c69591a7507 to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/archive/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/f2/bc2d11b846954f89875a3c69591a7507 2023-02-15 21:02:01,824 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/recovered.edits/12.seqid to hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/archive/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361/recovered.edits/12.seqid 2023-02-15 21:02:01,825 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/.tmp/data/default/testWithMapReduce/c03ac4df26a22cc3426c9d536cba9361 2023-02-15 21:02:01,825 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-15 21:02:01,826 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,828 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-15 21:02:01,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-15 21:02:01,830 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,830 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-15 21:02:01,830 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676494921830"}]},"ts":"9223372036854775807"} 2023-02-15 21:02:01,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-15 21:02:01,832 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c03ac4df26a22cc3426c9d536cba9361, NAME => 'testWithMapReduce,,1676494918715.c03ac4df26a22cc3426c9d536cba9361.', STARTKEY => '', ENDKEY => ''}] 2023-02-15 21:02:01,832 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-15 21:02:01,832 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676494921832"}]},"ts":"9223372036854775807"} 2023-02-15 21:02:01,833 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-15 21:02:01,835 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-15 21:02:01,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 26 msec 2023-02-15 21:02:01,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40417] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-15 21:02:01,914 INFO [Listener at localhost/40849] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-15 21:02:01,914 INFO [Listener at localhost/40849] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-15 21:02:01,914 INFO [Listener at localhost/40849] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-15 21:02:01,915 DEBUG [Listener at localhost/40849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15c0aa4d to 127.0.0.1:64256 2023-02-15 21:02:01,915 DEBUG [Listener at localhost/40849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:01,915 DEBUG [Listener at localhost/40849] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-15 21:02:01,915 DEBUG [Listener at localhost/40849] util.JVMClusterUtil(257): Found active master hash=519250531, stopped=false 2023-02-15 21:02:01,915 INFO [Listener at localhost/40849] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:02:01,917 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:02:01,917 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:02:01,917 INFO [Listener at localhost/40849] procedure2.ProcedureExecutor(629): Stopping 2023-02-15 21:02:01,917 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-15 21:02:01,917 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:02:01,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:02:01,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:02:01,918 DEBUG [Listener at localhost/40849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a025029 to 127.0.0.1:64256 2023-02-15 21:02:01,919 DEBUG [Listener at localhost/40849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:01,919 INFO [Listener at localhost/40849] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38137,1676494917562' ***** 2023-02-15 21:02:01,919 INFO [Listener at localhost/40849] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:02:01,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-15 21:02:01,919 INFO [Listener at localhost/40849] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35237,1676494917586' ***** 2023-02-15 21:02:01,919 INFO [Listener at localhost/40849] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-15 21:02:01,919 INFO [RS:0;jenkins-hbase4:38137] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:02:01,919 INFO [RS:1;jenkins-hbase4:35237] regionserver.HeapMemoryManager(220): Stopping 2023-02-15 21:02:01,919 INFO [RS:0;jenkins-hbase4:38137] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:02:01,919 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:02:01,919 INFO [RS:0;jenkins-hbase4:38137] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:02:01,919 INFO [RS:1;jenkins-hbase4:35237] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-15 21:02:01,920 INFO [RS:1;jenkins-hbase4:35237] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-15 21:02:01,921 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-15 21:02:01,921 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(3304): Received CLOSE for 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:02:01,921 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:02:01,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 77e8c157e55577ddac1772545891e1a1, disabling compactions & flushes 2023-02-15 21:02:01,920 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:02:01,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:02:01,921 DEBUG [RS:0;jenkins-hbase4:38137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23eadaab to 127.0.0.1:64256 2023-02-15 21:02:01,921 DEBUG [RS:1;jenkins-hbase4:35237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15431cfb to 127.0.0.1:64256 2023-02-15 21:02:01,922 DEBUG [RS:0;jenkins-hbase4:38137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:01,922 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38137,1676494917562; all regions closed. 2023-02-15 21:02:01,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:02:01,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. after waiting 0 ms 2023-02-15 21:02:01,922 DEBUG [RS:1;jenkins-hbase4:35237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:01,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:02:01,922 INFO [RS:1;jenkins-hbase4:35237] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:02:01,922 INFO [RS:1;jenkins-hbase4:35237] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:02:01,922 INFO [RS:1;jenkins-hbase4:35237] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:02:01,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 77e8c157e55577ddac1772545891e1a1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-15 21:02:01,922 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-15 21:02:01,922 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-15 21:02:01,922 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 77e8c157e55577ddac1772545891e1a1=hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1.} 2023-02-15 21:02:01,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-15 21:02:01,922 DEBUG [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1505): Waiting on 1588230740, 77e8c157e55577ddac1772545891e1a1 2023-02-15 21:02:01,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-15 21:02:01,923 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-15 21:02:01,923 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-15 21:02:01,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-15 21:02:01,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-15 21:02:01,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-15 21:02:01,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-15 21:02:01,926 DEBUG [RS:0;jenkins-hbase4:38137] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/oldWALs 2023-02-15 21:02:01,926 INFO [RS:0;jenkins-hbase4:38137] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38137%2C1676494917562:(num 1676494918889) 2023-02-15 21:02:01,926 DEBUG [RS:0;jenkins-hbase4:38137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:01,926 INFO [RS:0;jenkins-hbase4:38137] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:02:01,926 INFO [RS:0;jenkins-hbase4:38137] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-15 21:02:01,926 INFO [RS:0;jenkins-hbase4:38137] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-15 21:02:01,926 INFO [RS:0;jenkins-hbase4:38137] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-15 21:02:01,926 INFO [RS:0;jenkins-hbase4:38137] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-15 21:02:01,926 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:02:01,927 INFO [RS:0;jenkins-hbase4:38137] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38137 2023-02-15 21:02:01,929 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:02:01,929 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38137,1676494917562 2023-02-15 21:02:01,929 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:02:01,929 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:02:01,929 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:02:01,929 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a6f4ae1 rejected from java.util.concurrent.ThreadPoolExecutor@6e50c374[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:01,930 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38137,1676494917562] 2023-02-15 21:02:01,930 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38137,1676494917562; numProcessing=1 2023-02-15 21:02:01,931 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38137,1676494917562 already deleted, retry=false 2023-02-15 21:02:01,931 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38137,1676494917562 expired; onlineServers=1 2023-02-15 21:02:01,933 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/.tmp/info/70e4cfbeec354e3e8681e3c60e9bc0e6 2023-02-15 21:02:01,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/.tmp/info/53b4853b809c4267b382cf06f324edc4 2023-02-15 21:02:01,936 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70e4cfbeec354e3e8681e3c60e9bc0e6 2023-02-15 21:02:01,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/.tmp/info/53b4853b809c4267b382cf06f324edc4 as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/info/53b4853b809c4267b382cf06f324edc4 2023-02-15 21:02:01,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/info/53b4853b809c4267b382cf06f324edc4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-15 21:02:01,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 77e8c157e55577ddac1772545891e1a1 in 19ms, sequenceid=6, compaction requested=false 2023-02-15 21:02:01,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/.tmp/rep_barrier/36f4bb5853e14c999218294f81a21d13 2023-02-15 21:02:01,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/namespace/77e8c157e55577ddac1772545891e1a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-15 21:02:01,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:02:01,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 77e8c157e55577ddac1772545891e1a1: 2023-02-15 21:02:01,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676494918199.77e8c157e55577ddac1772545891e1a1. 2023-02-15 21:02:01,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36f4bb5853e14c999218294f81a21d13 2023-02-15 21:02:01,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/.tmp/table/9bb0f7c6f84341c4bacec9fb3874cadb 2023-02-15 21:02:01,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bb0f7c6f84341c4bacec9fb3874cadb 2023-02-15 21:02:01,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/.tmp/info/70e4cfbeec354e3e8681e3c60e9bc0e6 as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/info/70e4cfbeec354e3e8681e3c60e9bc0e6 2023-02-15 21:02:01,960 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:02:01,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70e4cfbeec354e3e8681e3c60e9bc0e6 2023-02-15 21:02:01,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/info/70e4cfbeec354e3e8681e3c60e9bc0e6, entries=12, sequenceid=21, filesize=6.2 K 2023-02-15 21:02:01,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/.tmp/rep_barrier/36f4bb5853e14c999218294f81a21d13 as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/rep_barrier/36f4bb5853e14c999218294f81a21d13 2023-02-15 21:02:01,963 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:02:01,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36f4bb5853e14c999218294f81a21d13 2023-02-15 21:02:01,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/rep_barrier/36f4bb5853e14c999218294f81a21d13, entries=1, sequenceid=21, filesize=5.0 K 2023-02-15 21:02:01,968 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/.tmp/table/9bb0f7c6f84341c4bacec9fb3874cadb as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/table/9bb0f7c6f84341c4bacec9fb3874cadb 2023-02-15 21:02:01,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bb0f7c6f84341c4bacec9fb3874cadb 2023-02-15 21:02:01,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/table/9bb0f7c6f84341c4bacec9fb3874cadb, entries=4, sequenceid=21, filesize=5.0 K 2023-02-15 21:02:01,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-15 21:02:01,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-15 21:02:01,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-15 21:02:01,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-15 21:02:01,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-15 21:02:01,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-15 21:02:02,116 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:02:02,116 INFO [RS:0;jenkins-hbase4:38137] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38137,1676494917562; zookeeper connection closed. 2023-02-15 21:02:02,116 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a1b253c rejected from java.util.concurrent.ThreadPoolExecutor@6e50c374[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,117 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:38137-0x10059ca39420001, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:02:02,117 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7290758d rejected from java.util.concurrent.ThreadPoolExecutor@6e50c374[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,117 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8ea043c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8ea043c 2023-02-15 21:02:02,122 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35237,1676494917586; all regions closed. 2023-02-15 21:02:02,126 DEBUG [RS:1;jenkins-hbase4:35237] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/oldWALs 2023-02-15 21:02:02,126 INFO [RS:1;jenkins-hbase4:35237] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35237%2C1676494917586.meta:.meta(num 1676494918151) 2023-02-15 21:02:02,130 DEBUG [RS:1;jenkins-hbase4:35237] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/oldWALs 2023-02-15 21:02:02,130 INFO [RS:1;jenkins-hbase4:35237] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35237%2C1676494917586:(num 1676494918537) 2023-02-15 21:02:02,130 DEBUG [RS:1;jenkins-hbase4:35237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:02,130 INFO [RS:1;jenkins-hbase4:35237] regionserver.LeaseManager(133): Closed leases 2023-02-15 21:02:02,131 INFO [RS:1;jenkins-hbase4:35237] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-15 21:02:02,131 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:02:02,133 INFO [RS:1;jenkins-hbase4:35237] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35237 2023-02-15 21:02:02,136 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35237,1676494917586 2023-02-15 21:02:02,136 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-15 21:02:02,136 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2403c035 rejected from java.util.concurrent.ThreadPoolExecutor@203c406d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,137 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35237,1676494917586] 2023-02-15 21:02:02,137 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35237,1676494917586; numProcessing=2 2023-02-15 21:02:02,138 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35237,1676494917586 already deleted, retry=false 2023-02-15 21:02:02,138 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35237,1676494917586 expired; onlineServers=0 2023-02-15 21:02:02,138 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40417,1676494917518' ***** 2023-02-15 21:02:02,138 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-15 21:02:02,139 DEBUG [M:0;jenkins-hbase4:40417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1accb565, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-15 21:02:02,139 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40417,1676494917518 2023-02-15 21:02:02,139 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40417,1676494917518; all regions closed. 2023-02-15 21:02:02,139 DEBUG [M:0;jenkins-hbase4:40417] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-15 21:02:02,139 DEBUG [M:0;jenkins-hbase4:40417] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-15 21:02:02,139 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-15 21:02:02,139 DEBUG [M:0;jenkins-hbase4:40417] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-15 21:02:02,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494917752] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676494917752,5,FailOnTimeoutGroup] 2023-02-15 21:02:02,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494917758] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676494917758,5,FailOnTimeoutGroup] 2023-02-15 21:02:02,139 INFO [M:0;jenkins-hbase4:40417] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-15 21:02:02,140 INFO [M:0;jenkins-hbase4:40417] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-15 21:02:02,140 INFO [M:0;jenkins-hbase4:40417] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-15 21:02:02,140 DEBUG [M:0;jenkins-hbase4:40417] master.HMaster(1512): Stopping service threads 2023-02-15 21:02:02,140 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-15 21:02:02,140 INFO [M:0;jenkins-hbase4:40417] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-15 21:02:02,140 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-15 21:02:02,141 ERROR [M:0;jenkins-hbase4:40417] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-15 21:02:02,141 INFO [M:0;jenkins-hbase4:40417] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-15 21:02:02,141 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-15 21:02:02,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-15 21:02:02,142 DEBUG [M:0;jenkins-hbase4:40417] zookeeper.ZKUtil(398): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-15 21:02:02,142 WARN [M:0;jenkins-hbase4:40417] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-15 21:02:02,142 INFO [M:0;jenkins-hbase4:40417] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-15 21:02:02,142 INFO [M:0;jenkins-hbase4:40417] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-15 21:02:02,142 DEBUG [M:0;jenkins-hbase4:40417] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-15 21:02:02,142 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:02:02,142 DEBUG [M:0;jenkins-hbase4:40417] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:02:02,142 DEBUG [M:0;jenkins-hbase4:40417] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-15 21:02:02,142 DEBUG [M:0;jenkins-hbase4:40417] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:02:02,142 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.68 KB heapSize=65.67 KB 2023-02-15 21:02:02,149 INFO [M:0;jenkins-hbase4:40417] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/66a0757049d24c689ecf9bda1bdbb33a 2023-02-15 21:02:02,153 DEBUG [M:0;jenkins-hbase4:40417] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/66a0757049d24c689ecf9bda1bdbb33a as hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/66a0757049d24c689ecf9bda1bdbb33a 2023-02-15 21:02:02,157 INFO [M:0;jenkins-hbase4:40417] regionserver.HStore(1080): Added hdfs://localhost:44151/user/jenkins/test-data/03209f41-ed9d-185a-79b1-5c53e02f2c42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/66a0757049d24c689ecf9bda1bdbb33a, entries=17, sequenceid=132, filesize=8.6 K 2023-02-15 21:02:02,158 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegion(2947): Finished flush of dataSize ~54.68 KB/55994, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-15 21:02:02,158 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-15 21:02:02,158 DEBUG [M:0;jenkins-hbase4:40417] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-15 21:02:02,160 INFO [M:0;jenkins-hbase4:40417] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-15 21:02:02,160 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-15 21:02:02,161 INFO [M:0;jenkins-hbase4:40417] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40417 2023-02-15 21:02:02,163 DEBUG [M:0;jenkins-hbase4:40417] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40417,1676494917518 already deleted, retry=false 2023-02-15 21:02:02,518 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:02:02,518 INFO [M:0;jenkins-hbase4:40417] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40417,1676494917518; zookeeper connection closed. 2023-02-15 21:02:02,518 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19693243 rejected from java.util.concurrent.ThreadPoolExecutor@1d56b5b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,519 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): master:40417-0x10059ca39420000, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:02:02,519 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@39ed855a rejected from java.util.concurrent.ThreadPoolExecutor@1d56b5b6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,618 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:02:02,618 INFO [RS:1;jenkins-hbase4:35237] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35237,1676494917586; zookeeper connection closed. 2023-02-15 21:02:02,618 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e299977 rejected from java.util.concurrent.ThreadPoolExecutor@203c406d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,618 DEBUG [Listener at localhost/40849-EventThread] zookeeper.ZKWatcher(600): regionserver:35237-0x10059ca39420002, quorum=127.0.0.1:64256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-15 21:02:02,618 ERROR [Listener at localhost/40849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16ece328 rejected from java.util.concurrent.ThreadPoolExecutor@203c406d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-15 21:02:02,618 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f7a3cf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f7a3cf 2023-02-15 21:02:02,618 INFO [Listener at localhost/40849] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-15 21:02:02,619 WARN [Listener at localhost/40849] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:02:02,623 INFO [Listener at localhost/40849] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:02:02,724 WARN [BP-1299165303-172.31.14.131-1676494916857 heartbeating to localhost/127.0.0.1:44151] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:02:02,724 WARN [BP-1299165303-172.31.14.131-1676494916857 heartbeating to localhost/127.0.0.1:44151] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1299165303-172.31.14.131-1676494916857 (Datanode Uuid cf6d5573-78c8-452a-bd0f-8dfcd43aede8) service to localhost/127.0.0.1:44151 2023-02-15 21:02:02,725 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/dfs/data/data3/current/BP-1299165303-172.31.14.131-1676494916857] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:02:02,725 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/dfs/data/data4/current/BP-1299165303-172.31.14.131-1676494916857] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:02:02,727 WARN [Listener at localhost/40849] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-15 21:02:02,730 INFO [Listener at localhost/40849] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:02:02,831 WARN [BP-1299165303-172.31.14.131-1676494916857 heartbeating to localhost/127.0.0.1:44151] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-15 21:02:02,831 WARN [BP-1299165303-172.31.14.131-1676494916857 heartbeating to localhost/127.0.0.1:44151] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1299165303-172.31.14.131-1676494916857 (Datanode Uuid 1c06ef92-7dee-4ce1-bc04-1ca43711332c) service to localhost/127.0.0.1:44151 2023-02-15 21:02:02,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/dfs/data/data1/current/BP-1299165303-172.31.14.131-1676494916857] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:02:02,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b2b7645d-5307-7698-6297-1eaafc43c9f5/cluster_9b73525a-983a-2f28-f7a5-ff1d1b0f9e27/dfs/data/data2/current/BP-1299165303-172.31.14.131-1676494916857] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-15 21:02:02,842 INFO [Listener at localhost/40849] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-15 21:02:02,956 INFO [Listener at localhost/40849] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-15 21:02:02,987 INFO [Listener at localhost/40849] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-15 21:02:03,000 INFO [Listener at localhost/40849] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 275) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40849 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40417,1676494917518)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:44151 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44151 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44151 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44151 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:44151 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44151 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44151 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=600 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 262), ProcessCount=166 (was 166), AvailableMemoryMB=2637 (was 2673)