2023-02-18 10:00:55,055 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-18 10:00:55,100 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=168, AvailableMemoryMB=11027 2023-02-18 10:00:55,349 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711 2023-02-18 10:00:55,356 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:00:55,356 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553, deleteOnExit=true 2023-02-18 10:00:55,357 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:00:55,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/test.cache.data in system properties and HBase conf 2023-02-18 10:00:55,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:00:55,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:00:55,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:00:55,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:00:55,359 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:00:55,487 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-18 10:00:55,835 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:00:55,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:00:55,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:00:55,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:00:55,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:00:55,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:00:55,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:00:55,842 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:00:55,842 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:00:55,842 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:00:55,843 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:00:55,843 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:00:55,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:00:55,844 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:00:55,845 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:00:56,289 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:00:56,293 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:00:56,563 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-18 10:00:56,710 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-18 10:00:56,722 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:00:56,756 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:00:56,785 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/java.io.tmpdir/Jetty_localhost_42601_hdfs____.hbdihp/webapp 2023-02-18 10:00:56,919 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42601 2023-02-18 10:00:56,931 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:00:56,932 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:00:57,421 WARN [Listener at localhost/39907] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:00:57,525 WARN [Listener at localhost/39907] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:00:57,548 WARN [Listener at localhost/39907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:00:57,555 INFO [Listener at localhost/39907] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:00:57,561 INFO [Listener at localhost/39907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/java.io.tmpdir/Jetty_localhost_36597_datanode____qkopmf/webapp 2023-02-18 10:00:57,676 INFO [Listener at localhost/39907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36597 2023-02-18 10:00:58,087 WARN [Listener at localhost/44913] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:00:58,127 WARN [Listener at localhost/44913] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:00:58,131 WARN [Listener at localhost/44913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:00:58,134 INFO [Listener at localhost/44913] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:00:58,144 INFO [Listener at localhost/44913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/java.io.tmpdir/Jetty_localhost_39739_datanode____kjf76m/webapp 2023-02-18 10:00:58,265 INFO [Listener at localhost/44913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39739 2023-02-18 10:00:58,276 WARN [Listener at localhost/42661] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:00:58,585 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3b45ad138d6a043: Processing first storage report for DS-17c71a63-dcbd-4aed-a14c-a8d589c72582 from datanode 2aa0f3c2-99c5-42ec-aa97-9a91740af3c3 2023-02-18 10:00:58,586 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3b45ad138d6a043: from storage DS-17c71a63-dcbd-4aed-a14c-a8d589c72582 node DatanodeRegistration(127.0.0.1:46445, datanodeUuid=2aa0f3c2-99c5-42ec-aa97-9a91740af3c3, infoPort=44133, infoSecurePort=0, ipcPort=44913, storageInfo=lv=-57;cid=testClusterID;nsid=607045950;c=1676714456381), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 10:00:58,587 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3b45ad138d6a043: Processing first storage report for DS-977057e2-7a84-4ef4-84ab-df7dee349fda from datanode 2aa0f3c2-99c5-42ec-aa97-9a91740af3c3 2023-02-18 10:00:58,587 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3b45ad138d6a043: from storage DS-977057e2-7a84-4ef4-84ab-df7dee349fda node DatanodeRegistration(127.0.0.1:46445, datanodeUuid=2aa0f3c2-99c5-42ec-aa97-9a91740af3c3, infoPort=44133, infoSecurePort=0, ipcPort=44913, storageInfo=lv=-57;cid=testClusterID;nsid=607045950;c=1676714456381), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:00:58,588 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x314cd7b3def22f16: Processing first storage report for DS-68748884-bf1e-4731-a2c1-5b6e218337e7 from datanode 8ab0f0b7-9a1d-41b6-92a7-e0a81530c981 2023-02-18 10:00:58,589 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x314cd7b3def22f16: from storage DS-68748884-bf1e-4731-a2c1-5b6e218337e7 node DatanodeRegistration(127.0.0.1:37059, datanodeUuid=8ab0f0b7-9a1d-41b6-92a7-e0a81530c981, infoPort=39065, infoSecurePort=0, ipcPort=42661, storageInfo=lv=-57;cid=testClusterID;nsid=607045950;c=1676714456381), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 10:00:58,589 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x314cd7b3def22f16: Processing first storage report for DS-2a25c927-2cc4-458c-ae5a-0961633aa063 from datanode 8ab0f0b7-9a1d-41b6-92a7-e0a81530c981 2023-02-18 10:00:58,589 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x314cd7b3def22f16: from storage DS-2a25c927-2cc4-458c-ae5a-0961633aa063 node DatanodeRegistration(127.0.0.1:37059, datanodeUuid=8ab0f0b7-9a1d-41b6-92a7-e0a81530c981, infoPort=39065, infoSecurePort=0, ipcPort=42661, storageInfo=lv=-57;cid=testClusterID;nsid=607045950;c=1676714456381), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:00:58,717 DEBUG [Listener at localhost/42661] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711 2023-02-18 10:00:58,802 INFO [Listener at localhost/42661] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/zookeeper_0, clientPort=52953, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:00:58,820 INFO [Listener at localhost/42661] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52953 2023-02-18 10:00:58,829 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:00:58,832 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:00:59,537 INFO [Listener at localhost/42661] util.FSUtils(479): Created version file at hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c with version=8 2023-02-18 10:00:59,537 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:00:59,539 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:00:59,543 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/hbase-staging 2023-02-18 10:00:59,886 INFO [Listener at localhost/42661] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-18 10:01:00,356 INFO [Listener at localhost/42661] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:00,388 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,389 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,389 INFO [Listener at localhost/42661] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:00,389 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,389 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:00,530 INFO [Listener at localhost/42661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:00,601 DEBUG [Listener at localhost/42661] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-18 10:01:00,712 INFO [Listener at localhost/42661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41097 2023-02-18 10:01:00,722 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:00,724 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:00,746 INFO [Listener at localhost/42661] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41097 connecting to ZooKeeper ensemble=127.0.0.1:52953 2023-02-18 10:01:00,791 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:410970x0, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:00,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41097-0x10066e028630000 connected 2023-02-18 10:01:00,822 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:00,823 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:00,827 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:00,838 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41097 2023-02-18 10:01:00,839 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41097 2023-02-18 10:01:00,839 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41097 2023-02-18 10:01:00,840 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41097 2023-02-18 10:01:00,841 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41097 2023-02-18 10:01:00,849 INFO [Listener at localhost/42661] master.HMaster(444): hbase.rootdir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c, hbase.cluster.distributed=false 2023-02-18 10:01:00,919 INFO [Listener at localhost/42661] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:00,919 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,919 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,919 INFO [Listener at localhost/42661] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:00,919 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,920 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:00,924 INFO [Listener at localhost/42661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:00,927 INFO [Listener at localhost/42661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42455 2023-02-18 10:01:00,930 INFO [Listener at localhost/42661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:00,937 DEBUG [Listener at localhost/42661] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:00,938 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:00,940 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:00,942 INFO [Listener at localhost/42661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42455 connecting to ZooKeeper ensemble=127.0.0.1:52953 2023-02-18 10:01:00,946 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:424550x0, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:00,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42455-0x10066e028630001 connected 2023-02-18 10:01:00,948 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:00,949 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:00,950 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:00,951 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42455 2023-02-18 10:01:00,951 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42455 2023-02-18 10:01:00,951 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42455 2023-02-18 10:01:00,955 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42455 2023-02-18 10:01:00,955 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42455 2023-02-18 10:01:00,968 INFO [Listener at localhost/42661] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:00,968 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,969 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,969 INFO [Listener at localhost/42661] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:00,970 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:00,970 INFO [Listener at localhost/42661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:00,970 INFO [Listener at localhost/42661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:00,972 INFO [Listener at localhost/42661] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42481 2023-02-18 10:01:00,972 INFO [Listener at localhost/42661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:00,975 DEBUG [Listener at localhost/42661] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:00,976 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:00,978 INFO [Listener at localhost/42661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:00,982 INFO [Listener at localhost/42661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42481 connecting to ZooKeeper ensemble=127.0.0.1:52953 2023-02-18 10:01:00,988 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:424810x0, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:00,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42481-0x10066e028630002 connected 2023-02-18 10:01:00,989 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:00,990 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:00,990 DEBUG [Listener at localhost/42661] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:00,991 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42481 2023-02-18 10:01:00,991 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42481 2023-02-18 10:01:00,992 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42481 2023-02-18 10:01:00,996 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42481 2023-02-18 10:01:00,996 DEBUG [Listener at localhost/42661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42481 2023-02-18 10:01:00,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,007 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:01,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,027 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:01,027 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:01,027 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:01,027 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:01,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:01,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:01,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41097,1676714459706 from backup master directory 2023-02-18 10:01:01,033 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,033 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:01,035 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:01,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-18 10:01:01,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-18 10:01:01,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/hbase.id with ID: f67341f9-de1b-4edc-ad47-0ba7af12e38a 2023-02-18 10:01:01,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:01,180 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:01,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x40039029 to 127.0.0.1:52953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:01,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@733d0a2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:01,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:01,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:01,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-18 10:01:01,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-18 10:01:01,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-18 10:01:01,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-18 10:01:01,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:01,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store-tmp 2023-02-18 10:01:01,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:01,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:01,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:01,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:01,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:01,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:01,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:01,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:01,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/WALs/jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41097%2C1676714459706, suffix=, logDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/WALs/jenkins-hbase4.apache.org,41097,1676714459706, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:01,504 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK] 2023-02-18 10:01:01,504 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK] 2023-02-18 10:01:01,516 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-18 10:01:01,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/WALs/jenkins-hbase4.apache.org,41097,1676714459706/jenkins-hbase4.apache.org%2C41097%2C1676714459706.1676714461436 2023-02-18 10:01:01,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK], DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK]] 2023-02-18 10:01:01,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:01,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:01,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:01,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:01,665 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:01,672 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:01,699 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:01,711 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:01,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:01,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:01,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:01,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:01,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68580657, jitterRate=0.021931424736976624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:01,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:01,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:01,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:01,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:01,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:01,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-18 10:01:01,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-18 10:01:01,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:01,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:01,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:01,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:01,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:01,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:01,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:01,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:01,900 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:01,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:01,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:01,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:01,925 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:01,925 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:01,925 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:01,926 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:01,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41097,1676714459706, sessionid=0x10066e028630000, setting cluster-up flag (Was=false) 2023-02-18 10:01:01,945 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:01,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:01,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,960 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:01,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:01,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:01,971 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.hbase-snapshot/.tmp 2023-02-18 10:01:02,003 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(952): ClusterId : f67341f9-de1b-4edc-ad47-0ba7af12e38a 2023-02-18 10:01:02,006 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(952): ClusterId : f67341f9-de1b-4edc-ad47-0ba7af12e38a 2023-02-18 10:01:02,011 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:02,011 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:02,018 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:02,018 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:02,018 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:02,019 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:02,024 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:02,029 DEBUG [RS:1;jenkins-hbase4:42481] zookeeper.ReadOnlyZKClient(139): Connect 0x028c3b90 to 127.0.0.1:52953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:02,034 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:02,037 DEBUG [RS:0;jenkins-hbase4:42455] zookeeper.ReadOnlyZKClient(139): Connect 0x44268468 to 127.0.0.1:52953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:02,061 DEBUG [RS:1;jenkins-hbase4:42481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bd2f362, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:02,063 DEBUG [RS:1;jenkins-hbase4:42481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36fa3565, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:02,064 DEBUG [RS:0;jenkins-hbase4:42455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41b6b4f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:02,065 DEBUG [RS:0;jenkins-hbase4:42455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@725470dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:02,096 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42481 2023-02-18 10:01:02,096 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42455 2023-02-18 10:01:02,102 INFO [RS:1;jenkins-hbase4:42481] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:02,103 INFO [RS:1;jenkins-hbase4:42481] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:02,102 INFO [RS:0;jenkins-hbase4:42455] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:02,103 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:02,103 INFO [RS:0;jenkins-hbase4:42455] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:02,103 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:02,105 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41097,1676714459706 with isa=jenkins-hbase4.apache.org/172.31.14.131:42481, startcode=1676714460967 2023-02-18 10:01:02,105 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41097,1676714459706 with isa=jenkins-hbase4.apache.org/172.31.14.131:42455, startcode=1676714460918 2023-02-18 10:01:02,125 DEBUG [RS:0;jenkins-hbase4:42455] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:02,125 DEBUG [RS:1;jenkins-hbase4:42481] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:02,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:02,197 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49999, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:02,197 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60633, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:02,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:02,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:02,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:02,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:02,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:02,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:02,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:02,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:02,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714492206 2023-02-18 10:01:02,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:02,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:02,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:02,213 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:02,213 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:02,218 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:02,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:02,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:02,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:02,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:02,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:02,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:02,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:02,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:02,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:02,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:02,247 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(2829): Master is not running yet 2023-02-18 10:01:02,247 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(2829): Master is not running yet 2023-02-18 10:01:02,247 WARN [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-18 10:01:02,247 WARN [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-18 10:01:02,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:02,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714462249,5,FailOnTimeoutGroup] 2023-02-18 10:01:02,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714462250,5,FailOnTimeoutGroup] 2023-02-18 10:01:02,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:02,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:02,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:02,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:02,287 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:02,288 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:02,288 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c 2023-02-18 10:01:02,309 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:02,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:02,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/info 2023-02-18 10:01:02,317 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:02,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:02,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:02,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:02,321 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:02,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:02,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:02,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/table 2023-02-18 10:01:02,325 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:02,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:02,328 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740 2023-02-18 10:01:02,329 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740 2023-02-18 10:01:02,332 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:02,335 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:02,339 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:02,341 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65424451, jitterRate=-0.025099709630012512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:02,341 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:02,341 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:02,341 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:02,341 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:02,341 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:02,341 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:02,342 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:02,342 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:02,347 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:02,347 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:02,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:02,376 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:02,378 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:02,529 WARN [jenkins-hbase4:41097] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-18 10:01:03,248 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41097,1676714459706 with isa=jenkins-hbase4.apache.org/172.31.14.131:42455, startcode=1676714460918 2023-02-18 10:01:03,249 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41097,1676714459706 with isa=jenkins-hbase4.apache.org/172.31.14.131:42481, startcode=1676714460967 2023-02-18 10:01:03,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,261 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c 2023-02-18 10:01:03,261 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c 2023-02-18 10:01:03,261 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39907 2023-02-18 10:01:03,262 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39907 2023-02-18 10:01:03,262 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:03,262 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:03,271 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:03,271 DEBUG [RS:1;jenkins-hbase4:42481] zookeeper.ZKUtil(162): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,271 DEBUG [RS:0;jenkins-hbase4:42455] zookeeper.ZKUtil(162): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,271 WARN [RS:1;jenkins-hbase4:42481] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:03,272 WARN [RS:0;jenkins-hbase4:42455] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:03,272 INFO [RS:1;jenkins-hbase4:42481] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:03,272 INFO [RS:0;jenkins-hbase4:42455] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:03,273 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,273 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,273 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42455,1676714460918] 2023-02-18 10:01:03,274 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42481,1676714460967] 2023-02-18 10:01:03,281 DEBUG [jenkins-hbase4:41097] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:03,284 DEBUG [RS:0;jenkins-hbase4:42455] zookeeper.ZKUtil(162): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,286 DEBUG [jenkins-hbase4:41097] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:03,287 DEBUG [RS:1;jenkins-hbase4:42481] zookeeper.ZKUtil(162): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,287 DEBUG [RS:0;jenkins-hbase4:42455] zookeeper.ZKUtil(162): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,287 DEBUG [RS:1;jenkins-hbase4:42481] zookeeper.ZKUtil(162): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,291 DEBUG [jenkins-hbase4:41097] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:03,292 DEBUG [jenkins-hbase4:41097] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:03,292 DEBUG [jenkins-hbase4:41097] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:03,295 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42455,1676714460918, state=OPENING 2023-02-18 10:01:03,300 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:03,300 DEBUG [RS:1;jenkins-hbase4:42481] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:03,305 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:03,306 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:03,307 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:03,312 INFO [RS:1;jenkins-hbase4:42481] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:03,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:03,313 INFO [RS:0;jenkins-hbase4:42455] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:03,341 INFO [RS:0;jenkins-hbase4:42455] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:03,341 INFO [RS:1;jenkins-hbase4:42481] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:03,346 INFO [RS:0;jenkins-hbase4:42455] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:03,346 INFO [RS:1;jenkins-hbase4:42481] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:03,346 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,346 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,348 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:03,348 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:03,357 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,357 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,358 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,358 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,358 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,358 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,358 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,358 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:03,359 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:03,359 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,359 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,360 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,360 DEBUG [RS:0;jenkins-hbase4:42455] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,360 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,360 DEBUG [RS:1;jenkins-hbase4:42481] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:03,361 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,361 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,361 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,367 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,368 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,368 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,380 INFO [RS:0;jenkins-hbase4:42455] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:03,381 INFO [RS:1;jenkins-hbase4:42481] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:03,384 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42455,1676714460918-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,384 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42481,1676714460967-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,410 INFO [RS:1;jenkins-hbase4:42481] regionserver.Replication(203): jenkins-hbase4.apache.org,42481,1676714460967 started 2023-02-18 10:01:03,410 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42481,1676714460967, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42481, sessionid=0x10066e028630002 2023-02-18 10:01:03,412 INFO [RS:0;jenkins-hbase4:42455] regionserver.Replication(203): jenkins-hbase4.apache.org,42455,1676714460918 started 2023-02-18 10:01:03,412 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:03,412 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42455,1676714460918, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42455, sessionid=0x10066e028630001 2023-02-18 10:01:03,412 DEBUG [RS:1;jenkins-hbase4:42481] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,412 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:03,412 DEBUG [RS:1;jenkins-hbase4:42481] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42481,1676714460967' 2023-02-18 10:01:03,412 DEBUG [RS:0;jenkins-hbase4:42455] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,413 DEBUG [RS:1;jenkins-hbase4:42481] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:03,413 DEBUG [RS:0;jenkins-hbase4:42455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42455,1676714460918' 2023-02-18 10:01:03,413 DEBUG [RS:0;jenkins-hbase4:42455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:03,414 DEBUG [RS:1;jenkins-hbase4:42481] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:03,414 DEBUG [RS:0;jenkins-hbase4:42455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:03,415 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:03,415 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:03,415 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:03,415 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:03,415 DEBUG [RS:0;jenkins-hbase4:42455] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,415 DEBUG [RS:1;jenkins-hbase4:42481] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:03,415 DEBUG [RS:0;jenkins-hbase4:42455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42455,1676714460918' 2023-02-18 10:01:03,416 DEBUG [RS:0;jenkins-hbase4:42455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:03,415 DEBUG [RS:1;jenkins-hbase4:42481] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42481,1676714460967' 2023-02-18 10:01:03,416 DEBUG [RS:1;jenkins-hbase4:42481] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:03,416 DEBUG [RS:0;jenkins-hbase4:42455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:03,416 DEBUG [RS:1;jenkins-hbase4:42481] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:03,417 DEBUG [RS:0;jenkins-hbase4:42455] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:03,417 DEBUG [RS:1;jenkins-hbase4:42481] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:03,417 INFO [RS:0;jenkins-hbase4:42455] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:03,417 INFO [RS:1;jenkins-hbase4:42481] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:03,417 INFO [RS:0;jenkins-hbase4:42455] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:03,417 INFO [RS:1;jenkins-hbase4:42481] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:03,500 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:03,502 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:03,506 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:03,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:03,521 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:03,524 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42455%2C1676714460918.meta, suffix=.meta, logDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42455,1676714460918, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/oldWALs, maxLogs=32 2023-02-18 10:01:03,547 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK] 2023-02-18 10:01:03,548 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK] 2023-02-18 10:01:03,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42455,1676714460918/jenkins-hbase4.apache.org%2C42455%2C1676714460918.meta.1676714463529.meta 2023-02-18 10:01:03,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK], DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK]] 2023-02-18 10:01:03,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:03,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:03,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:03,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:03,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:03,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:03,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:03,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:03,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:03,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/info 2023-02-18 10:01:03,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/info 2023-02-18 10:01:03,597 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:03,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:03,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:03,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:03,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:03,601 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:03,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:03,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:03,604 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/table 2023-02-18 10:01:03,604 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/table 2023-02-18 10:01:03,605 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:03,606 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:03,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740 2023-02-18 10:01:03,616 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740 2023-02-18 10:01:03,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:03,625 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:03,627 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60839517, jitterRate=-0.09342055022716522}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:03,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:03,639 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714463492 2023-02-18 10:01:03,660 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:03,661 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:03,664 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42455,1676714460918, state=OPEN 2023-02-18 10:01:03,668 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:03,668 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:03,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:03,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42455,1676714460918 in 356 msec 2023-02-18 10:01:03,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:03,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.3140 sec 2023-02-18 10:01:03,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.6040 sec 2023-02-18 10:01:03,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714463685, completionTime=-1 2023-02-18 10:01:03,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:03,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:03,760 DEBUG [hconnection-0x285c56a2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:03,764 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:03,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:03,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714523781 2023-02-18 10:01:03,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714583781 2023-02-18 10:01:03,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 95 msec 2023-02-18 10:01:03,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41097,1676714459706-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41097,1676714459706-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41097,1676714459706-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41097, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:03,813 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:03,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:03,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:03,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:03,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:03,839 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:03,862 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:03,866 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9 empty. 2023-02-18 10:01:03,867 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:03,867 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:03,896 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:03,899 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a3cb202432ad1580fbea89b0c9fb48d9, NAME => 'hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:03,921 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:03,921 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a3cb202432ad1580fbea89b0c9fb48d9, disabling compactions & flushes 2023-02-18 10:01:03,921 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:03,921 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:03,921 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. after waiting 0 ms 2023-02-18 10:01:03,921 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:03,921 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:03,921 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a3cb202432ad1580fbea89b0c9fb48d9: 2023-02-18 10:01:03,926 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:03,940 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714463928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714463928"}]},"ts":"1676714463928"} 2023-02-18 10:01:03,969 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:03,971 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:03,975 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714463971"}]},"ts":"1676714463971"} 2023-02-18 10:01:03,980 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:03,985 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:03,986 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:03,986 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:03,986 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:03,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a3cb202432ad1580fbea89b0c9fb48d9, ASSIGN}] 2023-02-18 10:01:03,991 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a3cb202432ad1580fbea89b0c9fb48d9, ASSIGN 2023-02-18 10:01:03,994 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a3cb202432ad1580fbea89b0c9fb48d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42455,1676714460918; forceNewPlan=false, retain=false 2023-02-18 10:01:04,146 INFO [jenkins-hbase4:41097] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:04,148 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a3cb202432ad1580fbea89b0c9fb48d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:04,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714464147"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714464147"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714464147"}]},"ts":"1676714464147"} 2023-02-18 10:01:04,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a3cb202432ad1580fbea89b0c9fb48d9, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:04,314 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:04,318 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42455%2C1676714460918, suffix=, logDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42455,1676714460918, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/oldWALs, maxLogs=32 2023-02-18 10:01:04,335 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK] 2023-02-18 10:01:04,335 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK] 2023-02-18 10:01:04,340 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42455,1676714460918/jenkins-hbase4.apache.org%2C42455%2C1676714460918.1676714464319 2023-02-18 10:01:04,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK], DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK]] 2023-02-18 10:01:04,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3cb202432ad1580fbea89b0c9fb48d9, NAME => 'hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:04,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,343 INFO [StoreOpener-a3cb202432ad1580fbea89b0c9fb48d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,345 DEBUG [StoreOpener-a3cb202432ad1580fbea89b0c9fb48d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/info 2023-02-18 10:01:04,345 DEBUG [StoreOpener-a3cb202432ad1580fbea89b0c9fb48d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/info 2023-02-18 10:01:04,346 INFO [StoreOpener-a3cb202432ad1580fbea89b0c9fb48d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3cb202432ad1580fbea89b0c9fb48d9 columnFamilyName info 2023-02-18 10:01:04,347 INFO [StoreOpener-a3cb202432ad1580fbea89b0c9fb48d9-1] regionserver.HStore(310): Store=a3cb202432ad1580fbea89b0c9fb48d9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:04,349 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,350 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:04,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:04,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a3cb202432ad1580fbea89b0c9fb48d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60291541, jitterRate=-0.10158602893352509}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:04,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a3cb202432ad1580fbea89b0c9fb48d9: 2023-02-18 10:01:04,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9., pid=6, masterSystemTime=1676714464307 2023-02-18 10:01:04,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:04,366 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:04,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a3cb202432ad1580fbea89b0c9fb48d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:04,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714464367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714464367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714464367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714464367"}]},"ts":"1676714464367"} 2023-02-18 10:01:04,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:04,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a3cb202432ad1580fbea89b0c9fb48d9, server=jenkins-hbase4.apache.org,42455,1676714460918 in 222 msec 2023-02-18 10:01:04,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:04,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a3cb202432ad1580fbea89b0c9fb48d9, ASSIGN in 390 msec 2023-02-18 10:01:04,384 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:04,384 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714464384"}]},"ts":"1676714464384"} 2023-02-18 10:01:04,388 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:04,391 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:04,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 566 msec 2023-02-18 10:01:04,428 INFO [RS:1;jenkins-hbase4:42481] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42481%2C1676714460967, suffix=, logDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42481,1676714460967, archiveDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/oldWALs, maxLogs=32 2023-02-18 10:01:04,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:04,438 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:04,438 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:04,457 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK] 2023-02-18 10:01:04,457 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK] 2023-02-18 10:01:04,471 INFO [RS:1;jenkins-hbase4:42481] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/WALs/jenkins-hbase4.apache.org,42481,1676714460967/jenkins-hbase4.apache.org%2C42481%2C1676714460967.1676714464431 2023-02-18 10:01:04,472 DEBUG [RS:1;jenkins-hbase4:42481] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37059,DS-68748884-bf1e-4731-a2c1-5b6e218337e7,DISK], DatanodeInfoWithStorage[127.0.0.1:46445,DS-17c71a63-dcbd-4aed-a14c-a8d589c72582,DISK]] 2023-02-18 10:01:04,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:04,511 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:04,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-02-18 10:01:04,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:04,540 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:04,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-02-18 10:01:04,559 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:04,561 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:04,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.526sec 2023-02-18 10:01:04,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:04,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:04,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:04,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41097,1676714459706-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:04,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41097,1676714459706-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:04,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:04,611 DEBUG [Listener at localhost/42661] zookeeper.ReadOnlyZKClient(139): Connect 0x0217176f to 127.0.0.1:52953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:04,648 DEBUG [Listener at localhost/42661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c4f887, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:04,688 DEBUG [hconnection-0x7ffbf007-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:04,703 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41948, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:04,713 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:04,713 DEBUG [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:04,723 DEBUG [Listener at localhost/42661] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:04,727 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:04,733 INFO [Listener at localhost/42661] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 10:01:04,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 10:01:04,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:04,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:43216 deadline: 1676714524738, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 10:01:04,742 INFO [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 10:01:04,756 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:04,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 10:01:04,760 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:04,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:04,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 10:01:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:04,784 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:04,784 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:04,784 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:04,785 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:04,785 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:04,785 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:04,785 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:04,785 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:04,787 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe empty. 2023-02-18 10:01:04,787 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d empty. 2023-02-18 10:01:04,787 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 empty. 2023-02-18 10:01:04,787 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c empty. 2023-02-18 10:01:04,787 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 empty. 2023-02-18 10:01:04,789 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c empty. 2023-02-18 10:01:04,787 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f empty. 2023-02-18 10:01:04,789 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 empty. 2023-02-18 10:01:04,789 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:04,790 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 empty. 2023-02-18 10:01:04,791 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc empty. 2023-02-18 10:01:04,791 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:04,791 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:04,791 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:04,791 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 10:01:04,812 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:04,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0a4468ba2137967a0b71fcead817084f, NAME => 'testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 45edc51324ca19560f9647702ac14bbe, NAME => 'testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e3e105fd1debe3e252412be4837fd262, NAME => 'testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:04,893 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,893 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e3e105fd1debe3e252412be4837fd262, disabling compactions & flushes 2023-02-18 10:01:04,894 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:04,894 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:04,894 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. after waiting 0 ms 2023-02-18 10:01:04,894 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:04,894 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:04,894 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:04,895 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 623b475a0d56201ee830d0e9267ae43d, NAME => 'testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,923 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,923 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 623b475a0d56201ee830d0e9267ae43d, disabling compactions & flushes 2023-02-18 10:01:04,923 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:04,923 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:04,923 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. after waiting 0 ms 2023-02-18 10:01:04,923 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:04,923 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:04,923 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:04,924 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ed85f164b1809f7b1ecd534d7b00b20c, NAME => 'testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ed85f164b1809f7b1ecd534d7b00b20c, disabling compactions & flushes 2023-02-18 10:01:04,937 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:04,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:04,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. after waiting 0 ms 2023-02-18 10:01:04,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:04,937 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:04,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:04,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 672ff14dbb542680a24b060219bc1f2c, NAME => 'testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 672ff14dbb542680a24b060219bc1f2c, disabling compactions & flushes 2023-02-18 10:01:04,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:04,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:04,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. after waiting 0 ms 2023-02-18 10:01:04,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:04,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:04,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:04,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 87bf6eac89746e1f2531d57c2b49dac4, NAME => 'testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 87bf6eac89746e1f2531d57c2b49dac4, disabling compactions & flushes 2023-02-18 10:01:04,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:04,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:04,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. after waiting 0 ms 2023-02-18 10:01:04,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:04,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:04,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:04,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 15875035428cf5fd626bfd148e4ee8d3, NAME => 'testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,977 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,977 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 15875035428cf5fd626bfd148e4ee8d3, disabling compactions & flushes 2023-02-18 10:01:04,977 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:04,977 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:04,977 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. after waiting 0 ms 2023-02-18 10:01:04,978 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:04,978 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:04,978 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:04,978 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => acdeb3bed9da590001464bbee81e47cc, NAME => 'testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:04,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:04,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing acdeb3bed9da590001464bbee81e47cc, disabling compactions & flushes 2023-02-18 10:01:04,990 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:04,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:04,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. after waiting 0 ms 2023-02-18 10:01:04,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:04,990 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:04,990 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:04,991 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9e7eceef8bb2aa1a832a9f8feb7e8c65, NAME => 'testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp 2023-02-18 10:01:05,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9e7eceef8bb2aa1a832a9f8feb7e8c65, disabling compactions & flushes 2023-02-18 10:01:05,007 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. after waiting 0 ms 2023-02-18 10:01:05,007 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,008 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,008 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:05,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:05,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,294 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0a4468ba2137967a0b71fcead817084f, disabling compactions & flushes 2023-02-18 10:01:05,294 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. after waiting 0 ms 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 45edc51324ca19560f9647702ac14bbe, disabling compactions & flushes 2023-02-18 10:01:05,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. after waiting 0 ms 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,295 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,295 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:05,301 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:05,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714465303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714465303"}]},"ts":"1676714465303"} 2023-02-18 10:01:05,355 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 10:01:05,357 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:05,357 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714465357"}]},"ts":"1676714465357"} 2023-02-18 10:01:05,360 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 10:01:05,365 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:05,378 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:05,378 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:05,378 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:05,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, ASSIGN}] 2023-02-18 10:01:05,383 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, ASSIGN 2023-02-18 10:01:05,383 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, ASSIGN 2023-02-18 10:01:05,384 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, ASSIGN 2023-02-18 10:01:05,384 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, ASSIGN 2023-02-18 10:01:05,386 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, ASSIGN 2023-02-18 10:01:05,386 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42455,1676714460918; forceNewPlan=false, retain=false 2023-02-18 10:01:05,386 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42481,1676714460967; forceNewPlan=false, retain=false 2023-02-18 10:01:05,386 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42481,1676714460967; forceNewPlan=false, retain=false 2023-02-18 10:01:05,386 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42455,1676714460918; forceNewPlan=false, retain=false 2023-02-18 10:01:05,388 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, ASSIGN 2023-02-18 10:01:05,388 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42481,1676714460967; forceNewPlan=false, retain=false 2023-02-18 10:01:05,388 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, ASSIGN 2023-02-18 10:01:05,389 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, ASSIGN 2023-02-18 10:01:05,389 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, ASSIGN 2023-02-18 10:01:05,390 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42455,1676714460918; forceNewPlan=false, retain=false 2023-02-18 10:01:05,391 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42481,1676714460967; forceNewPlan=false, retain=false 2023-02-18 10:01:05,391 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, ASSIGN 2023-02-18 10:01:05,391 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42455,1676714460918; forceNewPlan=false, retain=false 2023-02-18 10:01:05,391 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42481,1676714460967; forceNewPlan=false, retain=false 2023-02-18 10:01:05,393 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42455,1676714460918; forceNewPlan=false, retain=false 2023-02-18 10:01:05,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:05,536 INFO [jenkins-hbase4:41097] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 10:01:05,540 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=15875035428cf5fd626bfd148e4ee8d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,540 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=45edc51324ca19560f9647702ac14bbe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9e7eceef8bb2aa1a832a9f8feb7e8c65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,540 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465540"}]},"ts":"1676714465540"} 2023-02-18 10:01:05,540 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=672ff14dbb542680a24b060219bc1f2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,540 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=623b475a0d56201ee830d0e9267ae43d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,541 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714465540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465540"}]},"ts":"1676714465540"} 2023-02-18 10:01:05,541 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465540"}]},"ts":"1676714465540"} 2023-02-18 10:01:05,541 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714465540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465540"}]},"ts":"1676714465540"} 2023-02-18 10:01:05,541 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465540"}]},"ts":"1676714465540"} 2023-02-18 10:01:05,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 15875035428cf5fd626bfd148e4ee8d3, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:05,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 672ff14dbb542680a24b060219bc1f2c, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:05,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 9e7eceef8bb2aa1a832a9f8feb7e8c65, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:05,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 45edc51324ca19560f9647702ac14bbe, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:05,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0a4468ba2137967a0b71fcead817084f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,556 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465555"}]},"ts":"1676714465555"} 2023-02-18 10:01:05,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 623b475a0d56201ee830d0e9267ae43d, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:05,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 0a4468ba2137967a0b71fcead817084f, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:05,559 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=acdeb3bed9da590001464bbee81e47cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465559"}]},"ts":"1676714465559"} 2023-02-18 10:01:05,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=87bf6eac89746e1f2531d57c2b49dac4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465559"}]},"ts":"1676714465559"} 2023-02-18 10:01:05,560 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ed85f164b1809f7b1ecd534d7b00b20c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,560 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465560"}]},"ts":"1676714465560"} 2023-02-18 10:01:05,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure acdeb3bed9da590001464bbee81e47cc, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:05,566 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e3e105fd1debe3e252412be4837fd262, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 87bf6eac89746e1f2531d57c2b49dac4, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:05,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714465566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714465566"}]},"ts":"1676714465566"} 2023-02-18 10:01:05,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure ed85f164b1809f7b1ecd534d7b00b20c, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:05,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure e3e105fd1debe3e252412be4837fd262, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:05,699 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,699 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:05,702 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:05,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:05,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 672ff14dbb542680a24b060219bc1f2c, NAME => 'testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 10:01:05,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,712 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,714 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1 2023-02-18 10:01:05,714 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1 2023-02-18 10:01:05,715 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672ff14dbb542680a24b060219bc1f2c columnFamilyName f1 2023-02-18 10:01:05,716 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(310): Store=672ff14dbb542680a24b060219bc1f2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,716 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,720 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2 2023-02-18 10:01:05,720 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2 2023-02-18 10:01:05,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:05,722 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672ff14dbb542680a24b060219bc1f2c columnFamilyName f2 2023-02-18 10:01:05,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => acdeb3bed9da590001464bbee81e47cc, NAME => 'testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 10:01:05,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,723 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(310): Store=672ff14dbb542680a24b060219bc1f2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,726 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,728 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1 2023-02-18 10:01:05,729 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1 2023-02-18 10:01:05,729 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acdeb3bed9da590001464bbee81e47cc columnFamilyName f1 2023-02-18 10:01:05,730 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(310): Store=acdeb3bed9da590001464bbee81e47cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,732 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:05,734 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2 2023-02-18 10:01:05,734 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2 2023-02-18 10:01:05,735 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acdeb3bed9da590001464bbee81e47cc columnFamilyName f2 2023-02-18 10:01:05,736 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(310): Store=acdeb3bed9da590001464bbee81e47cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 672ff14dbb542680a24b060219bc1f2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68438827, jitterRate=0.01981799304485321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:05,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c., pid=22, masterSystemTime=1676714465698 2023-02-18 10:01:05,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:05,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:05,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9e7eceef8bb2aa1a832a9f8feb7e8c65, NAME => 'testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 10:01:05,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,753 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=672ff14dbb542680a24b060219bc1f2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,754 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465753"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465753"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465753"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465753"}]},"ts":"1676714465753"} 2023-02-18 10:01:05,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:05,760 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,763 DEBUG [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f1 2023-02-18 10:01:05,763 DEBUG [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f1 2023-02-18 10:01:05,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-18 10:01:05,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 672ff14dbb542680a24b060219bc1f2c, server=jenkins-hbase4.apache.org,42481,1676714460967 in 210 msec 2023-02-18 10:01:05,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened acdeb3bed9da590001464bbee81e47cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61609930, jitterRate=-0.08194050192832947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:05,763 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e7eceef8bb2aa1a832a9f8feb7e8c65 columnFamilyName f1 2023-02-18 10:01:05,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc., pid=27, masterSystemTime=1676714465715 2023-02-18 10:01:05,764 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(310): Store=9e7eceef8bb2aa1a832a9f8feb7e8c65/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, ASSIGN in 384 msec 2023-02-18 10:01:05,765 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,767 DEBUG [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f2 2023-02-18 10:01:05,767 DEBUG [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f2 2023-02-18 10:01:05,768 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e7eceef8bb2aa1a832a9f8feb7e8c65 columnFamilyName f2 2023-02-18 10:01:05,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:05,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:05,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:05,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87bf6eac89746e1f2531d57c2b49dac4, NAME => 'testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 10:01:05,768 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(310): Store=9e7eceef8bb2aa1a832a9f8feb7e8c65/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=acdeb3bed9da590001464bbee81e47cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,770 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465769"}]},"ts":"1676714465769"} 2023-02-18 10:01:05,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,772 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,775 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1 2023-02-18 10:01:05,775 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1 2023-02-18 10:01:05,776 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bf6eac89746e1f2531d57c2b49dac4 columnFamilyName f1 2023-02-18 10:01:05,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-18 10:01:05,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure acdeb3bed9da590001464bbee81e47cc, server=jenkins-hbase4.apache.org,42455,1676714460918 in 210 msec 2023-02-18 10:01:05,777 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(310): Store=87bf6eac89746e1f2531d57c2b49dac4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,778 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:05,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, ASSIGN in 399 msec 2023-02-18 10:01:05,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9e7eceef8bb2aa1a832a9f8feb7e8c65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73796520, jitterRate=0.09965384006500244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:05,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65., pid=23, masterSystemTime=1676714465698 2023-02-18 10:01:05,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:05,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:05,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 623b475a0d56201ee830d0e9267ae43d, NAME => 'testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 10:01:05,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,788 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9e7eceef8bb2aa1a832a9f8feb7e8c65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,789 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714465788"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465788"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465788"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465788"}]},"ts":"1676714465788"} 2023-02-18 10:01:05,790 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,792 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2 2023-02-18 10:01:05,793 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2 2023-02-18 10:01:05,795 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1 2023-02-18 10:01:05,795 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1 2023-02-18 10:01:05,795 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bf6eac89746e1f2531d57c2b49dac4 columnFamilyName f2 2023-02-18 10:01:05,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-18 10:01:05,796 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 623b475a0d56201ee830d0e9267ae43d columnFamilyName f1 2023-02-18 10:01:05,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 9e7eceef8bb2aa1a832a9f8feb7e8c65, server=jenkins-hbase4.apache.org,42481,1676714460967 in 241 msec 2023-02-18 10:01:05,797 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(310): Store=87bf6eac89746e1f2531d57c2b49dac4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,798 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(310): Store=623b475a0d56201ee830d0e9267ae43d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,798 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, ASSIGN in 418 msec 2023-02-18 10:01:05,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,801 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2 2023-02-18 10:01:05,801 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2 2023-02-18 10:01:05,801 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 623b475a0d56201ee830d0e9267ae43d columnFamilyName f2 2023-02-18 10:01:05,802 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(310): Store=623b475a0d56201ee830d0e9267ae43d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:05,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:05,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87bf6eac89746e1f2531d57c2b49dac4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68545850, jitterRate=0.021412760019302368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:05,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4., pid=28, masterSystemTime=1676714465715 2023-02-18 10:01:05,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:05,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:05,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:05,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e3e105fd1debe3e252412be4837fd262, NAME => 'testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 10:01:05,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=87bf6eac89746e1f2531d57c2b49dac4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465818"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465818"}]},"ts":"1676714465818"} 2023-02-18 10:01:05,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,827 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 623b475a0d56201ee830d0e9267ae43d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59954766, jitterRate=-0.10660436749458313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:05,830 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1 2023-02-18 10:01:05,830 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1 2023-02-18 10:01:05,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d., pid=25, masterSystemTime=1676714465698 2023-02-18 10:01:05,831 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3e105fd1debe3e252412be4837fd262 columnFamilyName f1 2023-02-18 10:01:05,832 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(310): Store=e3e105fd1debe3e252412be4837fd262/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,832 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:05,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:05,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-18 10:01:05,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 87bf6eac89746e1f2531d57c2b49dac4, server=jenkins-hbase4.apache.org,42455,1676714460918 in 263 msec 2023-02-18 10:01:05,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 45edc51324ca19560f9647702ac14bbe, NAME => 'testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 10:01:05,835 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=623b475a0d56201ee830d0e9267ae43d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,835 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465835"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465835"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465835"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465835"}]},"ts":"1676714465835"} 2023-02-18 10:01:05,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,836 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2 2023-02-18 10:01:05,837 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2 2023-02-18 10:01:05,838 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3e105fd1debe3e252412be4837fd262 columnFamilyName f2 2023-02-18 10:01:05,838 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, ASSIGN in 457 msec 2023-02-18 10:01:05,839 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(310): Store=e3e105fd1debe3e252412be4837fd262/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,841 DEBUG [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f1 2023-02-18 10:01:05,841 DEBUG [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f1 2023-02-18 10:01:05,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,841 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45edc51324ca19560f9647702ac14bbe columnFamilyName f1 2023-02-18 10:01:05,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,842 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(310): Store=45edc51324ca19560f9647702ac14bbe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,843 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-18 10:01:05,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 623b475a0d56201ee830d0e9267ae43d, server=jenkins-hbase4.apache.org,42481,1676714460967 in 282 msec 2023-02-18 10:01:05,845 DEBUG [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f2 2023-02-18 10:01:05,845 DEBUG [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f2 2023-02-18 10:01:05,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,845 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45edc51324ca19560f9647702ac14bbe columnFamilyName f2 2023-02-18 10:01:05,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, ASSIGN in 465 msec 2023-02-18 10:01:05,846 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(310): Store=45edc51324ca19560f9647702ac14bbe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:05,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e3e105fd1debe3e252412be4837fd262; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61682183, jitterRate=-0.0808638483285904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:05,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262., pid=30, masterSystemTime=1676714465715 2023-02-18 10:01:05,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:05,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:05,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:05,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:05,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ed85f164b1809f7b1ecd534d7b00b20c, NAME => 'testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 10:01:05,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e3e105fd1debe3e252412be4837fd262, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465858"}]},"ts":"1676714465858"} 2023-02-18 10:01:05,860 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 45edc51324ca19560f9647702ac14bbe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65348518, jitterRate=-0.026231199502944946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:05,863 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1 2023-02-18 10:01:05,863 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1 2023-02-18 10:01:05,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe., pid=24, masterSystemTime=1676714465698 2023-02-18 10:01:05,864 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed85f164b1809f7b1ecd534d7b00b20c columnFamilyName f1 2023-02-18 10:01:05,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-18 10:01:05,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure e3e105fd1debe3e252412be4837fd262, server=jenkins-hbase4.apache.org,42455,1676714460918 in 292 msec 2023-02-18 10:01:05,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:05,868 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(310): Store=ed85f164b1809f7b1ecd534d7b00b20c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:05,868 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 15875035428cf5fd626bfd148e4ee8d3, NAME => 'testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 10:01:05,868 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=45edc51324ca19560f9647702ac14bbe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,868 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714465868"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465868"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465868"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465868"}]},"ts":"1676714465868"} 2023-02-18 10:01:05,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, ASSIGN in 488 msec 2023-02-18 10:01:05,875 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,877 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1 2023-02-18 10:01:05,877 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1 2023-02-18 10:01:05,878 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15875035428cf5fd626bfd148e4ee8d3 columnFamilyName f1 2023-02-18 10:01:05,879 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(310): Store=15875035428cf5fd626bfd148e4ee8d3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,879 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,880 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2 2023-02-18 10:01:05,880 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2 2023-02-18 10:01:05,880 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed85f164b1809f7b1ecd534d7b00b20c columnFamilyName f2 2023-02-18 10:01:05,881 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(310): Store=ed85f164b1809f7b1ecd534d7b00b20c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,882 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2 2023-02-18 10:01:05,882 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2 2023-02-18 10:01:05,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,883 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15875035428cf5fd626bfd148e4ee8d3 columnFamilyName f2 2023-02-18 10:01:05,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,884 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(310): Store=15875035428cf5fd626bfd148e4ee8d3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-18 10:01:05,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 45edc51324ca19560f9647702ac14bbe, server=jenkins-hbase4.apache.org,42481,1676714460967 in 319 msec 2023-02-18 10:01:05,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, ASSIGN in 507 msec 2023-02-18 10:01:05,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:05,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ed85f164b1809f7b1ecd534d7b00b20c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58841800, jitterRate=-0.12318885326385498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:05,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c., pid=29, masterSystemTime=1676714465715 2023-02-18 10:01:05,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 15875035428cf5fd626bfd148e4ee8d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62193487, jitterRate=-0.07324482500553131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:05,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:05,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:05,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:05,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0a4468ba2137967a0b71fcead817084f, NAME => 'testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 10:01:05,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3., pid=21, masterSystemTime=1676714465698 2023-02-18 10:01:05,900 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ed85f164b1809f7b1ecd534d7b00b20c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:05,900 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465899"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465899"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465899"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465899"}]},"ts":"1676714465899"} 2023-02-18 10:01:05,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:05,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:05,903 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,903 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=15875035428cf5fd626bfd148e4ee8d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:05,904 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465903"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465903"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465903"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465903"}]},"ts":"1676714465903"} 2023-02-18 10:01:05,906 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1 2023-02-18 10:01:05,906 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1 2023-02-18 10:01:05,907 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a4468ba2137967a0b71fcead817084f columnFamilyName f1 2023-02-18 10:01:05,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-18 10:01:05,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure ed85f164b1809f7b1ecd534d7b00b20c, server=jenkins-hbase4.apache.org,42455,1676714460918 in 335 msec 2023-02-18 10:01:05,908 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(310): Store=0a4468ba2137967a0b71fcead817084f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,908 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, ASSIGN in 530 msec 2023-02-18 10:01:05,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-18 10:01:05,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 15875035428cf5fd626bfd148e4ee8d3, server=jenkins-hbase4.apache.org,42481,1676714460967 in 363 msec 2023-02-18 10:01:05,911 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2 2023-02-18 10:01:05,911 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2 2023-02-18 10:01:05,911 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a4468ba2137967a0b71fcead817084f columnFamilyName f2 2023-02-18 10:01:05,912 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(310): Store=0a4468ba2137967a0b71fcead817084f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:05,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, ASSIGN in 532 msec 2023-02-18 10:01:05,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:05,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:05,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:05,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0a4468ba2137967a0b71fcead817084f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69932518, jitterRate=0.04207572340965271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:05,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:05,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f., pid=26, masterSystemTime=1676714465715 2023-02-18 10:01:05,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:05,927 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0a4468ba2137967a0b71fcead817084f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:05,928 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714465927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714465927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714465927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714465927"}]},"ts":"1676714465927"} 2023-02-18 10:01:05,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-18 10:01:05,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 0a4468ba2137967a0b71fcead817084f, server=jenkins-hbase4.apache.org,42455,1676714460918 in 371 msec 2023-02-18 10:01:05,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-02-18 10:01:05,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, ASSIGN in 560 msec 2023-02-18 10:01:05,942 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:05,943 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714465943"}]},"ts":"1676714465943"} 2023-02-18 10:01:05,945 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 10:01:05,948 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:05,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1920 sec 2023-02-18 10:01:06,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:06,902 INFO [Listener at localhost/42661] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 10:01:06,902 DEBUG [Listener at localhost/42661] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 10:01:06,904 INFO [Listener at localhost/42661] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:06,914 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 10:01:06,915 INFO [Listener at localhost/42661] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:06,915 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 10:01:06,915 INFO [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:07,059 DEBUG [hconnection-0x7ffbf007-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:07,123 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60480, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:07,162 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42481] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:07,170 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42455] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:07,431 INFO [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:07,434 INFO [Listener at localhost/42661] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:07,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:07,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714467447 (current time:1676714467447). 2023-02-18 10:01:07,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:07,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] zookeeper.ReadOnlyZKClient(139): Connect 0x4b08e161 to 127.0.0.1:52953 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:07,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@664e3984, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:07,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:07,465 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41950, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:07,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b08e161 to 127.0.0.1:52953 2023-02-18 10:01:07,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:07,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:07,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:07,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:07,497 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:07,498 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676715067498 2023-02-18 10:01:07,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:07,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 10:01:07,501 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:07,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:07,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 15 msec 2023-02-18 10:01:07,504 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:07,505 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676715067505 2023-02-18 10:01:07,505 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:07,506 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:07,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-18 10:01:07,550 INFO [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-18 10:01:07,550 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:07,551 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-18 10:01:07,551 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 10:01:07,552 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:07,552 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:07,557 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:07,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:07,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:07,558 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:07,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:07,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:07,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:07,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:07,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:07,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-18 10:01:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-18 10:01:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:07,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 10:01:07,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 10:01:07,567 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-18 10:01:07,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-18 10:01:07,568 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-18 10:01:07,568 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,568 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-18 10:01:07,568 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:07,568 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:07,568 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,569 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 10:01:07,569 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 10:01:07,570 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-18 10:01:07,569 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-18 10:01:07,570 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42455,1676714460918' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-18 10:01:07,570 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42481,1676714460967' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-18 10:01:07,571 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,571 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:07,572 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,572 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:07,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:07,573 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,573 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:07,574 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,574 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:07,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:07,575 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,575 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:07,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:07,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:07,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42455,1676714460918' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-18 10:01:07,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40c5a8ac[Count = 1] remaining members to acquire global barrier 2023-02-18 10:01:07,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:07,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:07,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:07,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:07,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:07,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:07,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42481,1676714460967' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-18 10:01:07,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40c5a8ac[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:07,580 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 10:01:07,580 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:07,583 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:07,583 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:07,584 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:07,584 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:07,588 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:07,588 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:07,589 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. started... 2023-02-18 10:01:07,589 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. started... 2023-02-18 10:01:07,589 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:07,589 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. started... 2023-02-18 10:01:07,597 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 87bf6eac89746e1f2531d57c2b49dac4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:07,597 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ed85f164b1809f7b1ecd534d7b00b20c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:07,598 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:07,600 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 10:01:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:07,604 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:07,604 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. started... 2023-02-18 10:01:07,604 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 10:01:07,606 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:07,606 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:07,606 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:07,606 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. started... 2023-02-18 10:01:07,606 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegion(2744): Flushing acdeb3bed9da590001464bbee81e47cc 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 10:01:07,606 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:07,607 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. started... 2023-02-18 10:01:07,608 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 623b475a0d56201ee830d0e9267ae43d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:07,608 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 15875035428cf5fd626bfd148e4ee8d3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:07,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:07,615 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:07,620 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:07,620 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:07,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:07,632 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:07,682 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. completed. 2023-02-18 10:01:07,682 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:07,683 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:07,683 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 10:01:07,683 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. started... 2023-02-18 10:01:07,684 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:07,684 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:07,684 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:07,684 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:07,684 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:07,833 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:07,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:07,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:07,838 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 10:01:07,852 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f1/26e7b0b0c99c49448db25d221c829d5c 2023-02-18 10:01:07,859 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f1/7c660c759a3c4f3ab790419f8e24f6e1 2023-02-18 10:01:07,874 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f1/3b812249279b496dbc6f4c61b57f97b3 2023-02-18 10:01:07,877 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f1/2adefbb1e84e4e43b43a99e4865e9ef8 2023-02-18 10:01:07,881 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f1/673e02f4896842d5804ef63069a80243 2023-02-18 10:01:08,006 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f2/32678a1aa4dd4005b627adac1405025e 2023-02-18 10:01:08,007 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f2/cb0bdc6690c04adeb8d12bc8bc7d304a 2023-02-18 10:01:08,009 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f2/8c9816ea97b340efa62ec7b0d1e7727c 2023-02-18 10:01:08,010 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f2/fc8edbef2f964dba9c775c3270d0635c 2023-02-18 10:01:08,023 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f1/26e7b0b0c99c49448db25d221c829d5c as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/26e7b0b0c99c49448db25d221c829d5c 2023-02-18 10:01:08,026 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f1/7c660c759a3c4f3ab790419f8e24f6e1 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/7c660c759a3c4f3ab790419f8e24f6e1 2023-02-18 10:01:08,028 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f1/3b812249279b496dbc6f4c61b57f97b3 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/3b812249279b496dbc6f4c61b57f97b3 2023-02-18 10:01:08,028 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f1/2adefbb1e84e4e43b43a99e4865e9ef8 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/2adefbb1e84e4e43b43a99e4865e9ef8 2023-02-18 10:01:08,041 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/7c660c759a3c4f3ab790419f8e24f6e1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,041 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/26e7b0b0c99c49448db25d221c829d5c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:08,042 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/2adefbb1e84e4e43b43a99e4865e9ef8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,044 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f2/8c9816ea97b340efa62ec7b0d1e7727c as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/8c9816ea97b340efa62ec7b0d1e7727c 2023-02-18 10:01:08,044 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/3b812249279b496dbc6f4c61b57f97b3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,044 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f2/fc8edbef2f964dba9c775c3270d0635c as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/fc8edbef2f964dba9c775c3270d0635c 2023-02-18 10:01:08,045 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f2/32678a1aa4dd4005b627adac1405025e as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/32678a1aa4dd4005b627adac1405025e 2023-02-18 10:01:08,046 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f2/cb0bdc6690c04adeb8d12bc8bc7d304a as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/cb0bdc6690c04adeb8d12bc8bc7d304a 2023-02-18 10:01:08,055 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/fc8edbef2f964dba9c775c3270d0635c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,056 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/8c9816ea97b340efa62ec7b0d1e7727c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:08,056 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/32678a1aa4dd4005b627adac1405025e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,056 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 87bf6eac89746e1f2531d57c2b49dac4 in 460ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,057 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for acdeb3bed9da590001464bbee81e47cc in 451ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,057 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 623b475a0d56201ee830d0e9267ae43d in 449ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,058 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 10:01:08,058 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 10:01:08,058 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 10:01:08,059 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:08,060 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,060 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,060 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/2adefbb1e84e4e43b43a99e4865e9ef8] hfiles 2023-02-18 10:01:08,060 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/2adefbb1e84e4e43b43a99e4865e9ef8 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,061 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:08,061 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:08,061 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,061 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,061 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,062 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,062 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/26e7b0b0c99c49448db25d221c829d5c] hfiles 2023-02-18 10:01:08,062 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/7c660c759a3c4f3ab790419f8e24f6e1] hfiles 2023-02-18 10:01:08,062 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/7c660c759a3c4f3ab790419f8e24f6e1 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,062 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/26e7b0b0c99c49448db25d221c829d5c for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,065 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/8c9816ea97b340efa62ec7b0d1e7727c] hfiles 2023-02-18 10:01:08,065 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/32678a1aa4dd4005b627adac1405025e] hfiles 2023-02-18 10:01:08,065 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/fc8edbef2f964dba9c775c3270d0635c] hfiles 2023-02-18 10:01:08,065 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/32678a1aa4dd4005b627adac1405025e for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,065 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/8c9816ea97b340efa62ec7b0d1e7727c for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,065 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/fc8edbef2f964dba9c775c3270d0635c for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,066 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/cb0bdc6690c04adeb8d12bc8bc7d304a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,067 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 15875035428cf5fd626bfd148e4ee8d3 in 459ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/3b812249279b496dbc6f4c61b57f97b3] hfiles 2023-02-18 10:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/3b812249279b496dbc6f4c61b57f97b3 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,068 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/cb0bdc6690c04adeb8d12bc8bc7d304a] hfiles 2023-02-18 10:01:08,069 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/cb0bdc6690c04adeb8d12bc8bc7d304a for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,096 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. completed. 2023-02-18 10:01:08,096 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:08,097 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:08,097 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. started... 2023-02-18 10:01:08,097 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 10:01:08,100 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. completed. 2023-02-18 10:01:08,100 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:08,098 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 672ff14dbb542680a24b060219bc1f2c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:08,100 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 10:01:08,100 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:08,101 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. started... 2023-02-18 10:01:08,103 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e3e105fd1debe3e252412be4837fd262 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 10:01:08,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. completed. 2023-02-18 10:01:08,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:08,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:08,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. started... 2023-02-18 10:01:08,104 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 10:01:08,105 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0a4468ba2137967a0b71fcead817084f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:08,107 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. completed. 2023-02-18 10:01:08,107 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:08,107 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 10:01:08,138 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:08,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:08,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:08,140 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 10:01:08,156 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f1/09bd77b1cd49498f8f74fe1a89f300a9 2023-02-18 10:01:08,174 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f1/66cdc6799bd44350a94a80a835ef1c67 2023-02-18 10:01:08,198 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. completed. 2023-02-18 10:01:08,198 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:08,198 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 10:01:08,205 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f2/a326f85c7c1d4e528c6de4c62d543025 2023-02-18 10:01:08,215 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f1/09bd77b1cd49498f8f74fe1a89f300a9 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/09bd77b1cd49498f8f74fe1a89f300a9 2023-02-18 10:01:08,215 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f2/5b5645f9e71f4a5bbde6343b92f9851d 2023-02-18 10:01:08,225 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/09bd77b1cd49498f8f74fe1a89f300a9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,225 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f1/66cdc6799bd44350a94a80a835ef1c67 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/66cdc6799bd44350a94a80a835ef1c67 2023-02-18 10:01:08,226 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f2/a326f85c7c1d4e528c6de4c62d543025 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/a326f85c7c1d4e528c6de4c62d543025 2023-02-18 10:01:08,235 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/66cdc6799bd44350a94a80a835ef1c67, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,236 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/a326f85c7c1d4e528c6de4c62d543025, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,238 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 672ff14dbb542680a24b060219bc1f2c in 140ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f2/5b5645f9e71f4a5bbde6343b92f9851d as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/5b5645f9e71f4a5bbde6343b92f9851d 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/09bd77b1cd49498f8f74fe1a89f300a9] hfiles 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/09bd77b1cd49498f8f74fe1a89f300a9 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,238 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/a326f85c7c1d4e528c6de4c62d543025] hfiles 2023-02-18 10:01:08,239 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/a326f85c7c1d4e528c6de4c62d543025 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,247 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/5b5645f9e71f4a5bbde6343b92f9851d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,249 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0a4468ba2137967a0b71fcead817084f in 143ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/66cdc6799bd44350a94a80a835ef1c67] hfiles 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/66cdc6799bd44350a94a80a835ef1c67 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/5b5645f9e71f4a5bbde6343b92f9851d] hfiles 2023-02-18 10:01:08,249 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/5b5645f9e71f4a5bbde6343b92f9851d for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,260 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. completed. 2023-02-18 10:01:08,260 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:08,260 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 10:01:08,260 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 10:01:08,260 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,261 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-18 10:01:08,261 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42481,1676714460967' in zk 2023-02-18 10:01:08,266 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,266 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-18 10:01:08,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:08,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:08,266 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-18 10:01:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:08,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,271 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. completed. 2023-02-18 10:01:08,271 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:08,271 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 10:01:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42481,1676714460967': 2023-02-18 10:01:08,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42481,1676714460967' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 10:01:08,388 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f2/9a969b7c5d2642ff9cb81060f5c148ec 2023-02-18 10:01:08,397 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f1/673e02f4896842d5804ef63069a80243 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/673e02f4896842d5804ef63069a80243 2023-02-18 10:01:08,404 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/673e02f4896842d5804ef63069a80243, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,405 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f2/9a969b7c5d2642ff9cb81060f5c148ec as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/9a969b7c5d2642ff9cb81060f5c148ec 2023-02-18 10:01:08,412 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/9a969b7c5d2642ff9cb81060f5c148ec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:08,413 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ed85f164b1809f7b1ecd534d7b00b20c in 816ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,413 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:08,414 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,414 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,414 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/673e02f4896842d5804ef63069a80243] hfiles 2023-02-18 10:01:08,414 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/673e02f4896842d5804ef63069a80243 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,414 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/9a969b7c5d2642ff9cb81060f5c148ec] hfiles 2023-02-18 10:01:08,414 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/9a969b7c5d2642ff9cb81060f5c148ec for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,422 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. completed. 2023-02-18 10:01:08,422 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:08,422 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 10:01:08,565 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0 2023-02-18 10:01:08,585 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f2/0d53cccdb4ba4e8e99453a42d3bd0727 2023-02-18 10:01:08,592 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0 2023-02-18 10:01:08,599 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:08,606 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f2/0d53cccdb4ba4e8e99453a42d3bd0727 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/0d53cccdb4ba4e8e99453a42d3bd0727 2023-02-18 10:01:08,614 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/0d53cccdb4ba4e8e99453a42d3bd0727, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:08,616 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e3e105fd1debe3e252412be4837fd262 in 512ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0] hfiles 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/0d53cccdb4ba4e8e99453a42d3bd0727] hfiles 2023-02-18 10:01:08,616 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/0d53cccdb4ba4e8e99453a42d3bd0727 for snapshot=testWithMapReduceMultiRegion 2023-02-18 10:01:08,633 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. completed. 2023-02-18 10:01:08,633 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:08,633 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 10:01:08,633 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 10:01:08,633 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,633 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-18 10:01:08,633 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42455,1676714460918' in zk 2023-02-18 10:01:08,636 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,636 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-18 10:01:08,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:08,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:08,636 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:08,636 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-18 10:01:08,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:08,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42455,1676714460918': 2023-02-18 10:01:08,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42455,1676714460918' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:08,640 INFO [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-18 10:01:08,641 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:08,641 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:08,641 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:08,641 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-18 10:01:08,641 INFO [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:08,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:08,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:08,643 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-18 10:01:08,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:08,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:08,644 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:08,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:08,645 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,647 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,647 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:08,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 10:01:08,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-18 10:01:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:08,663 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:08,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:08,664 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:08,663 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:08,664 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:08,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:08,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-18 10:01:08,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:08,664 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 10:01:08,664 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 10:01:08,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:08,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:08,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:08,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 10:01:08,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-18 10:01:08,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-18 10:01:08,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 10:01:08,773 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 10:01:08,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676714467499Consolidate snapshot: testWithMapReduceMultiRegion at 1676714468663 (+1164 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676714468664 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676714468696 (+32 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676714468716 (+20 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676714468773 (+57 ms) 2023-02-18 10:01:08,775 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:08,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2740 sec 2023-02-18 10:01:09,129 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-18 10:01:09,307 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 10:01:09,308 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 10:01:09,643 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:09,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:09,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:09,645 INFO [Listener at localhost/42661] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:09,658 INFO [Listener at localhost/42661] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:09,669 INFO [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:09,730 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42481] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:09,742 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42455] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:09,881 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:09,882 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-18 10:01:09,885 INFO [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:09,899 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:09,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 10:01:09,904 INFO [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 10:01:09,904 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:09,904 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 10:01:09,905 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 10:01:09,905 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:09,905 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:09,907 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:09,907 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:09,907 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:09,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:09,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:09,907 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:09,907 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:09,908 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:09,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:09,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:09,908 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:09,909 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 10:01:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:09,909 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 10:01:09,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 10:01:09,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 10:01:09,911 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 10:01:09,911 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 10:01:09,911 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:09,911 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:09,912 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 10:01:09,912 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 10:01:09,913 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:09,914 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. started... 2023-02-18 10:01:09,914 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 87bf6eac89746e1f2531d57c2b49dac4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:09,915 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:09,915 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. started... 2023-02-18 10:01:09,915 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:09,915 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:09,915 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. started... 2023-02-18 10:01:09,915 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:09,915 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 623b475a0d56201ee830d0e9267ae43d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:09,920 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:09,920 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. started... 2023-02-18 10:01:09,920 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 15875035428cf5fd626bfd148e4ee8d3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:09,921 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:09,921 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. started... 2023-02-18 10:01:09,924 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 10:01:09,924 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 10:01:09,924 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ed85f164b1809f7b1ecd534d7b00b20c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:09,924 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:09,925 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. started... 2023-02-18 10:01:09,924 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:09,924 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:09,925 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 10:01:09,926 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing acdeb3bed9da590001464bbee81e47cc 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 10:01:09,924 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:09,925 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. started... 2023-02-18 10:01:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 10:01:09,927 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. started... 2023-02-18 10:01:09,928 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 672ff14dbb542680a24b060219bc1f2c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:09,992 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f1/a19154ca8419487f97c1e060ab629fdd 2023-02-18 10:01:09,995 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f1/abb7fa9dd8d14c34b9872be320569187 2023-02-18 10:01:09,996 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f1/efe5b84b8cfa4d979780e9ff368f3551 2023-02-18 10:01:09,997 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f1/e5d0e27062284d82848f188dc6e6a5fd 2023-02-18 10:01:10,023 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f1/669afcaeafd54c02996a94d55b8bcc9b 2023-02-18 10:01:10,066 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f2/1e716f99e0fd46959f44748ffc88fb0f 2023-02-18 10:01:10,067 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f2/9c16bc241600434eb5e93bd17acb234d 2023-02-18 10:01:10,070 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f2/e9888f3b3ab14185b40247cd47fca671 2023-02-18 10:01:10,074 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f2/cb2a94b6c70749298ca76fa612885480 2023-02-18 10:01:10,077 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f1/abb7fa9dd8d14c34b9872be320569187 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/abb7fa9dd8d14c34b9872be320569187 2023-02-18 10:01:10,078 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f1/a19154ca8419487f97c1e060ab629fdd as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/a19154ca8419487f97c1e060ab629fdd 2023-02-18 10:01:10,079 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f1/e5d0e27062284d82848f188dc6e6a5fd as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/e5d0e27062284d82848f188dc6e6a5fd 2023-02-18 10:01:10,083 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f1/669afcaeafd54c02996a94d55b8bcc9b as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/669afcaeafd54c02996a94d55b8bcc9b 2023-02-18 10:01:10,087 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/abb7fa9dd8d14c34b9872be320569187, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,087 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/a19154ca8419487f97c1e060ab629fdd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,089 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/e5d0e27062284d82848f188dc6e6a5fd, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:10,089 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/.tmp/f2/1e716f99e0fd46959f44748ffc88fb0f as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/1e716f99e0fd46959f44748ffc88fb0f 2023-02-18 10:01:10,089 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/.tmp/f2/9c16bc241600434eb5e93bd17acb234d as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/9c16bc241600434eb5e93bd17acb234d 2023-02-18 10:01:10,093 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/669afcaeafd54c02996a94d55b8bcc9b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,093 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/.tmp/f2/e9888f3b3ab14185b40247cd47fca671 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/e9888f3b3ab14185b40247cd47fca671 2023-02-18 10:01:10,094 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/.tmp/f2/cb2a94b6c70749298ca76fa612885480 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/cb2a94b6c70749298ca76fa612885480 2023-02-18 10:01:10,100 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/9c16bc241600434eb5e93bd17acb234d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,103 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 623b475a0d56201ee830d0e9267ae43d in 188ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,103 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/1e716f99e0fd46959f44748ffc88fb0f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,103 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:10,103 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 10:01:10,104 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 87bf6eac89746e1f2531d57c2b49dac4 in 190ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:10,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:10,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 10:01:10,104 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. started... 2023-02-18 10:01:10,105 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/cb2a94b6c70749298ca76fa612885480, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,105 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3e105fd1debe3e252412be4837fd262 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 10:01:10,107 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ed85f164b1809f7b1ecd534d7b00b20c in 182ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,107 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:10,107 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:10,107 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 10:01:10,107 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:10,108 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. started... 2023-02-18 10:01:10,108 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0a4468ba2137967a0b71fcead817084f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:10,111 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/e9888f3b3ab14185b40247cd47fca671, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:10,113 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for acdeb3bed9da590001464bbee81e47cc in 187ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,113 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:10,113 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:10,113 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 10:01:10,129 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f1/cb48341da4114730a67ebaca84905f8f 2023-02-18 10:01:10,136 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f1/c171f2a7ebd84fc6aee8f1b35858df32 2023-02-18 10:01:10,152 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f2/67725e4fd62849c785b91f1b14cf0d21 2023-02-18 10:01:10,155 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f2/d66be278828848b4bc4255d6b2cceeb6 2023-02-18 10:01:10,159 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f1/cb48341da4114730a67ebaca84905f8f as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/cb48341da4114730a67ebaca84905f8f 2023-02-18 10:01:10,162 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f1/c171f2a7ebd84fc6aee8f1b35858df32 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/c171f2a7ebd84fc6aee8f1b35858df32 2023-02-18 10:01:10,165 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/cb48341da4114730a67ebaca84905f8f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:10,167 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/.tmp/f2/67725e4fd62849c785b91f1b14cf0d21 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/67725e4fd62849c785b91f1b14cf0d21 2023-02-18 10:01:10,169 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/c171f2a7ebd84fc6aee8f1b35858df32, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,170 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/.tmp/f2/d66be278828848b4bc4255d6b2cceeb6 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/d66be278828848b4bc4255d6b2cceeb6 2023-02-18 10:01:10,174 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/67725e4fd62849c785b91f1b14cf0d21, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:10,175 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e3e105fd1debe3e252412be4837fd262 in 70ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,175 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:10,175 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:10,175 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 10:01:10,176 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/d66be278828848b4bc4255d6b2cceeb6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,177 INFO [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0a4468ba2137967a0b71fcead817084f in 69ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,177 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:10,177 DEBUG [rs(jenkins-hbase4.apache.org,42455,1676714460918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:10,177 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 10:01:10,177 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 10:01:10,177 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,177 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 10:01:10,178 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42455,1676714460918' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 10:01:10,180 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,180 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:10,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,181 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:10,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:10,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:10,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42455,1676714460918' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 10:01:10,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@244ba0d3[Count = 1] remaining members to acquire global barrier 2023-02-18 10:01:10,429 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f1/b5d51ed68fa34952bdd6c8c4f2c6fba8 2023-02-18 10:01:10,439 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f2/7aa7077b7674434ab4f08aa501e0d040 2023-02-18 10:01:10,446 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f1/efe5b84b8cfa4d979780e9ff368f3551 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/efe5b84b8cfa4d979780e9ff368f3551 2023-02-18 10:01:10,448 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f2/75f4ff40a571455291ff34d0e66430e6 2023-02-18 10:01:10,453 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/efe5b84b8cfa4d979780e9ff368f3551, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,454 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/.tmp/f2/7aa7077b7674434ab4f08aa501e0d040 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/7aa7077b7674434ab4f08aa501e0d040 2023-02-18 10:01:10,455 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f1/b5d51ed68fa34952bdd6c8c4f2c6fba8 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/b5d51ed68fa34952bdd6c8c4f2c6fba8 2023-02-18 10:01:10,460 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/7aa7077b7674434ab4f08aa501e0d040, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,461 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/b5d51ed68fa34952bdd6c8c4f2c6fba8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,462 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 15875035428cf5fd626bfd148e4ee8d3 in 542ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,462 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:10,462 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:10,462 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 10:01:10,464 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/.tmp/f2/75f4ff40a571455291ff34d0e66430e6 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/75f4ff40a571455291ff34d0e66430e6 2023-02-18 10:01:10,470 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/75f4ff40a571455291ff34d0e66430e6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:10,471 INFO [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 672ff14dbb542680a24b060219bc1f2c in 542ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:10,471 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:10,471 DEBUG [rs(jenkins-hbase4.apache.org,42481,1676714460967)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 10:01:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 10:01:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 10:01:10,471 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42481,1676714460967' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 10:01:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,473 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:10,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42481,1676714460967' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 10:01:10,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@244ba0d3[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:10,475 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 10:01:10,475 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,478 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,478 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 10:01:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 10:01:10,479 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 10:01:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 10:01:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42455,1676714460918' in zk 2023-02-18 10:01:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42481,1676714460967' in zk 2023-02-18 10:01:10,479 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,479 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:10,481 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 10:01:10,481 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,481 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:10,481 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,481 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 10:01:10,481 DEBUG [member: 'jenkins-hbase4.apache.org,42455,1676714460918' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 10:01:10,482 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:10,482 DEBUG [member: 'jenkins-hbase4.apache.org,42481,1676714460967' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 10:01:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42455,1676714460918': 2023-02-18 10:01:10,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42455,1676714460918' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-18 10:01:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42481,1676714460967': 2023-02-18 10:01:10,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42481,1676714460967' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 10:01:10,489 INFO [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 10:01:10,490 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:10,490 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:10,490 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 10:01:10,490 INFO [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:10,492 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:10,492 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,492 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:10,493 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,493 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,496 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:10,496 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:10,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,501 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,501 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:10,501 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:10,502 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:10,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:10,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:10,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:10,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:10,502 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:10,503 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:10,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:10,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:10,504 DEBUG [(jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:10,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 10:01:10,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:10,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:10,507 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:10,507 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:10,608 DEBUG [Listener at localhost/42661] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:10,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:10,710 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop-2638119441741540326.jar 2023-02-18 10:01:10,727 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676714467447 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:10,728 DEBUG [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce 2023-02-18 10:01:10,728 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(239): region to add: 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:10,729 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=45edc51324ca19560f9647702ac14bbe as 45edc51324ca19560f9647702ac14bbe in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=623b475a0d56201ee830d0e9267ae43d as 623b475a0d56201ee830d0e9267ae43d in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=87bf6eac89746e1f2531d57c2b49dac4 as 87bf6eac89746e1f2531d57c2b49dac4 in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=ed85f164b1809f7b1ecd534d7b00b20c as ed85f164b1809f7b1ecd534d7b00b20c in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=15875035428cf5fd626bfd148e4ee8d3 as 15875035428cf5fd626bfd148e4ee8d3 in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=9e7eceef8bb2aa1a832a9f8feb7e8c65 as 9e7eceef8bb2aa1a832a9f8feb7e8c65 in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=acdeb3bed9da590001464bbee81e47cc as acdeb3bed9da590001464bbee81e47cc in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=672ff14dbb542680a24b060219bc1f2c as 672ff14dbb542680a24b060219bc1f2c in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=e3e105fd1debe3e252412be4837fd262 as e3e105fd1debe3e252412be4837fd262 in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,730 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(585): clone region=0a4468ba2137967a0b71fcead817084f as 0a4468ba2137967a0b71fcead817084f in snapshot testWithMapReduceMultiRegion 2023-02-18 10:01:10,733 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => acdeb3bed9da590001464bbee81e47cc, NAME => 'testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,734 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 15875035428cf5fd626bfd148e4ee8d3, NAME => 'testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,734 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => ed85f164b1809f7b1ecd534d7b00b20c, NAME => 'testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,735 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 623b475a0d56201ee830d0e9267ae43d, NAME => 'testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,735 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 9e7eceef8bb2aa1a832a9f8feb7e8c65, NAME => 'testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,735 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 87bf6eac89746e1f2531d57c2b49dac4, NAME => 'testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,736 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 672ff14dbb542680a24b060219bc1f2c, NAME => 'testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,736 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 45edc51324ca19560f9647702ac14bbe, NAME => 'testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,765 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,765 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,765 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7c660c759a3c4f3ab790419f8e24f6e1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,765 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 26e7b0b0c99c49448db25d221c829d5c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 9e7eceef8bb2aa1a832a9f8feb7e8c65, disabling compactions & flushes 2023-02-18 10:01:10,772 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:10,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:10,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. after waiting 0 ms 2023-02-18 10:01:10,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:10,772 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:10,773 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:10,773 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e3e105fd1debe3e252412be4837fd262, NAME => 'testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,780 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c9816ea97b340efa62ec7b0d1e7727c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,783 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,783 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 673e02f4896842d5804ef63069a80243 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,792 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 32678a1aa4dd4005b627adac1405025e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,797 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing acdeb3bed9da590001464bbee81e47cc, disabling compactions & flushes 2023-02-18 10:01:10,797 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:10,797 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:10,797 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. after waiting 0 ms 2023-02-18 10:01:10,797 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:10,798 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:10,798 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:10,798 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 0a4468ba2137967a0b71fcead817084f, NAME => 'testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,800 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a969b7c5d2642ff9cb81060f5c148ec from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,808 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing ed85f164b1809f7b1ecd534d7b00b20c, disabling compactions & flushes 2023-02-18 10:01:10,809 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:10,809 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:10,809 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. after waiting 0 ms 2023-02-18 10:01:10,809 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:10,809 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:10,809 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:10,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 623b475a0d56201ee830d0e9267ae43d, disabling compactions & flushes 2023-02-18 10:01:10,811 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:10,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:10,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. after waiting 0 ms 2023-02-18 10:01:10,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:10,811 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:10,811 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:10,816 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,817 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b812249279b496dbc6f4c61b57f97b3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,824 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 45edc51324ca19560f9647702ac14bbe, disabling compactions & flushes 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,825 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2adefbb1e84e4e43b43a99e4865e9ef8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,825 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 09bd77b1cd49498f8f74fe1a89f300a9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,825 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. after waiting 0 ms 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:10,825 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:10,825 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:10,832 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb0bdc6690c04adeb8d12bc8bc7d304a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,836 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fc8edbef2f964dba9c775c3270d0635c from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,836 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a326f85c7c1d4e528c6de4c62d543025 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,841 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 15875035428cf5fd626bfd148e4ee8d3, disabling compactions & flushes 2023-02-18 10:01:10,842 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:10,842 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:10,842 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. after waiting 0 ms 2023-02-18 10:01:10,842 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:10,842 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:10,842 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:10,842 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,843 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 66cdc6799bd44350a94a80a835ef1c67 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 87bf6eac89746e1f2531d57c2b49dac4, disabling compactions & flushes 2023-02-18 10:01:10,843 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. after waiting 0 ms 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:10,843 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 672ff14dbb542680a24b060219bc1f2c, disabling compactions & flushes 2023-02-18 10:01:10,843 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:10,844 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:10,844 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd9ae7b1e8904d2396c743b1fdeb7fc0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,844 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:10,844 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. after waiting 0 ms 2023-02-18 10:01:10,844 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:10,844 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:10,844 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:10,845 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5b5645f9e71f4a5bbde6343b92f9851d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,846 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0d53cccdb4ba4e8e99453a42d3bd0727 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 10:01:10,849 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 0a4468ba2137967a0b71fcead817084f, disabling compactions & flushes 2023-02-18 10:01:10,849 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:10,849 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:10,849 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. after waiting 0 ms 2023-02-18 10:01:10,849 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:10,849 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:10,849 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:10,850 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e3e105fd1debe3e252412be4837fd262, disabling compactions & flushes 2023-02-18 10:01:10,850 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:10,850 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:10,850 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. after waiting 0 ms 2023-02-18 10:01:10,850 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:10,850 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:10,850 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:10,850 INFO [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676714467447 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:10,851 DEBUG [Listener at localhost/42661] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,851 DEBUG [Listener at localhost/42661] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3 2023-02-18 10:01:10,852 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:10,852 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:10,853 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 10:01:10,853 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------0a4468ba2137967a0b71fcead817084f/ 2023-02-18 10:01:10,854 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,854 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,854 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=0a4468ba2137967a0b71fcead817084f-66cdc6799bd44350a94a80a835ef1c67 2023-02-18 10:01:10,854 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,855 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=0a4468ba2137967a0b71fcead817084f-5b5645f9e71f4a5bbde6343b92f9851d 2023-02-18 10:01:10,855 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------15875035428cf5fd626bfd148e4ee8d3/ 2023-02-18 10:01:10,856 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,856 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,856 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=15875035428cf5fd626bfd148e4ee8d3-3b812249279b496dbc6f4c61b57f97b3 2023-02-18 10:01:10,856 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,857 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=15875035428cf5fd626bfd148e4ee8d3-cb0bdc6690c04adeb8d12bc8bc7d304a 2023-02-18 10:01:10,857 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------45edc51324ca19560f9647702ac14bbe/ 2023-02-18 10:01:10,858 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,858 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------623b475a0d56201ee830d0e9267ae43d/ 2023-02-18 10:01:10,858 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,859 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,859 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=623b475a0d56201ee830d0e9267ae43d-7c660c759a3c4f3ab790419f8e24f6e1 2023-02-18 10:01:10,859 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,860 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=623b475a0d56201ee830d0e9267ae43d-32678a1aa4dd4005b627adac1405025e 2023-02-18 10:01:10,860 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------672ff14dbb542680a24b060219bc1f2c/ 2023-02-18 10:01:10,861 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,861 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,861 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=672ff14dbb542680a24b060219bc1f2c-09bd77b1cd49498f8f74fe1a89f300a9 2023-02-18 10:01:10,862 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,862 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=672ff14dbb542680a24b060219bc1f2c-a326f85c7c1d4e528c6de4c62d543025 2023-02-18 10:01:10,862 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------87bf6eac89746e1f2531d57c2b49dac4/ 2023-02-18 10:01:10,863 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,863 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,863 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=87bf6eac89746e1f2531d57c2b49dac4-2adefbb1e84e4e43b43a99e4865e9ef8 2023-02-18 10:01:10,863 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,864 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=87bf6eac89746e1f2531d57c2b49dac4-fc8edbef2f964dba9c775c3270d0635c 2023-02-18 10:01:10,864 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------9e7eceef8bb2aa1a832a9f8feb7e8c65/ 2023-02-18 10:01:10,864 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,865 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------acdeb3bed9da590001464bbee81e47cc/ 2023-02-18 10:01:10,865 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,865 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,866 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=acdeb3bed9da590001464bbee81e47cc-26e7b0b0c99c49448db25d221c829d5c 2023-02-18 10:01:10,866 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,866 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=acdeb3bed9da590001464bbee81e47cc-8c9816ea97b340efa62ec7b0d1e7727c 2023-02-18 10:01:10,866 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------e3e105fd1debe3e252412be4837fd262/ 2023-02-18 10:01:10,867 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,867 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,867 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=e3e105fd1debe3e252412be4837fd262-dd9ae7b1e8904d2396c743b1fdeb7fc0 2023-02-18 10:01:10,867 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,868 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=e3e105fd1debe3e252412be4837fd262-0d53cccdb4ba4e8e99453a42d3bd0727 2023-02-18 10:01:10,868 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |----------ed85f164b1809f7b1ecd534d7b00b20c/ 2023-02-18 10:01:10,869 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:10,869 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:10,869 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=ed85f164b1809f7b1ecd534d7b00b20c-673e02f4896842d5804ef63069a80243 2023-02-18 10:01:10,869 DEBUG [Listener at localhost/42661] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:10,870 DEBUG [Listener at localhost/42661] util.CommonFSUtils(702): |----------------testWithMapReduce=ed85f164b1809f7b1ecd534d7b00b20c-9a969b7c5d2642ff9cb81060f5c148ec 2023-02-18 10:01:10,878 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,878 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,879 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,879 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,879 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,880 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,880 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,953 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop-7670230825758953414.jar 2023-02-18 10:01:10,954 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,954 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,955 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,955 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,956 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,956 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,957 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 10:01:10,957 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 10:01:10,957 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 10:01:10,958 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 10:01:10,958 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 10:01:10,959 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 10:01:10,959 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 10:01:10,960 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 10:01:10,960 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 10:01:10,961 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 10:01:10,966 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:10,966 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:10,967 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:10,967 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:10,968 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 10:01:11,053 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop-7975981556231644050.jar 2023-02-18 10:01:11,054 DEBUG [Listener at localhost/42661] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 10:01:11,118 WARN [Listener at localhost/42661] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 10:01:11,171 INFO [Listener at localhost/42661] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 10:01:11,602 WARN [Listener at localhost/42661] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/mapreduce.cluster.local.dir/1676714471497/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 10:01:11,602 WARN [Listener at localhost/42661] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/mapreduce.cluster.local.dir/1676714471497/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 10:01:11,759 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:11,759 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:11,765 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:11,772 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:11,777 DEBUG [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f1 2023-02-18 10:01:11,778 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45edc51324ca19560f9647702ac14bbe columnFamilyName f1 2023-02-18 10:01:11,778 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(310): Store=45edc51324ca19560f9647702ac14bbe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:11,779 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:11,780 DEBUG [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f2 2023-02-18 10:01:11,781 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45edc51324ca19560f9647702ac14bbe columnFamilyName f2 2023-02-18 10:01:11,781 INFO [StoreOpener-45edc51324ca19560f9647702ac14bbe-1] regionserver.HStore(310): Store=45edc51324ca19560f9647702ac14bbe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:11,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:11,782 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 45edc51324ca19560f9647702ac14bbe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71245124, jitterRate=0.06163507699966431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:11,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:11,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 45edc51324ca19560f9647702ac14bbe, disabling compactions & flushes 2023-02-18 10:01:11,822 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:11,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:11,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. after waiting 0 ms 2023-02-18 10:01:11,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:11,823 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:11,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:11,839 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:11,839 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:11,840 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:11,842 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:11,843 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1 2023-02-18 10:01:11,843 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672ff14dbb542680a24b060219bc1f2c columnFamilyName f1 2023-02-18 10:01:11,851 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/testWithMapReduce=672ff14dbb542680a24b060219bc1f2c-09bd77b1cd49498f8f74fe1a89f300a9 2023-02-18 10:01:11,851 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(310): Store=672ff14dbb542680a24b060219bc1f2c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:11,852 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:11,853 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2 2023-02-18 10:01:11,853 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 672ff14dbb542680a24b060219bc1f2c columnFamilyName f2 2023-02-18 10:01:11,861 DEBUG [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/testWithMapReduce=672ff14dbb542680a24b060219bc1f2c-a326f85c7c1d4e528c6de4c62d543025 2023-02-18 10:01:11,862 INFO [StoreOpener-672ff14dbb542680a24b060219bc1f2c-1] regionserver.HStore(310): Store=672ff14dbb542680a24b060219bc1f2c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:11,863 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:11,863 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 672ff14dbb542680a24b060219bc1f2c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75295061, jitterRate=0.1219838410615921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:11,863 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:12,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 672ff14dbb542680a24b060219bc1f2c, disabling compactions & flushes 2023-02-18 10:01:12,001 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:12,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:12,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. after waiting 1 ms 2023-02-18 10:01:12,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:12,009 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:12,009 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:12,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,016 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,018 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,020 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:12,021 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1 2023-02-18 10:01:12,021 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 623b475a0d56201ee830d0e9267ae43d columnFamilyName f1 2023-02-18 10:01:12,029 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/testWithMapReduce=623b475a0d56201ee830d0e9267ae43d-7c660c759a3c4f3ab790419f8e24f6e1 2023-02-18 10:01:12,029 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(310): Store=623b475a0d56201ee830d0e9267ae43d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,029 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:12,030 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2 2023-02-18 10:01:12,031 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 623b475a0d56201ee830d0e9267ae43d columnFamilyName f2 2023-02-18 10:01:12,036 DEBUG [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/testWithMapReduce=623b475a0d56201ee830d0e9267ae43d-32678a1aa4dd4005b627adac1405025e 2023-02-18 10:01:12,037 INFO [StoreOpener-623b475a0d56201ee830d0e9267ae43d-1] regionserver.HStore(310): Store=623b475a0d56201ee830d0e9267ae43d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,037 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 623b475a0d56201ee830d0e9267ae43d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70138181, jitterRate=0.045140340924263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:12,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 623b475a0d56201ee830d0e9267ae43d, disabling compactions & flushes 2023-02-18 10:01:12,086 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:12,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:12,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. after waiting 0 ms 2023-02-18 10:01:12,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:12,097 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:12,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:12,103 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,103 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,107 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,111 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:12,112 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1 2023-02-18 10:01:12,113 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3e105fd1debe3e252412be4837fd262 columnFamilyName f1 2023-02-18 10:01:12,120 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/testWithMapReduce=e3e105fd1debe3e252412be4837fd262-dd9ae7b1e8904d2396c743b1fdeb7fc0 2023-02-18 10:01:12,120 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(310): Store=e3e105fd1debe3e252412be4837fd262/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,120 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:12,121 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2 2023-02-18 10:01:12,122 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3e105fd1debe3e252412be4837fd262 columnFamilyName f2 2023-02-18 10:01:12,147 DEBUG [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/testWithMapReduce=e3e105fd1debe3e252412be4837fd262-0d53cccdb4ba4e8e99453a42d3bd0727 2023-02-18 10:01:12,147 INFO [StoreOpener-e3e105fd1debe3e252412be4837fd262-1] regionserver.HStore(310): Store=e3e105fd1debe3e252412be4837fd262/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,148 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,148 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e3e105fd1debe3e252412be4837fd262; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68111850, jitterRate=0.014945656061172485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,148 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:12,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e3e105fd1debe3e252412be4837fd262, disabling compactions & flushes 2023-02-18 10:01:12,261 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:12,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:12,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. after waiting 0 ms 2023-02-18 10:01:12,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:12,265 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:12,265 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:12,274 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,274 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,285 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,293 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:12,294 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1 2023-02-18 10:01:12,295 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a4468ba2137967a0b71fcead817084f columnFamilyName f1 2023-02-18 10:01:12,302 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/testWithMapReduce=0a4468ba2137967a0b71fcead817084f-66cdc6799bd44350a94a80a835ef1c67 2023-02-18 10:01:12,303 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(310): Store=0a4468ba2137967a0b71fcead817084f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,303 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:12,305 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2 2023-02-18 10:01:12,305 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a4468ba2137967a0b71fcead817084f columnFamilyName f2 2023-02-18 10:01:12,327 DEBUG [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/testWithMapReduce=0a4468ba2137967a0b71fcead817084f-5b5645f9e71f4a5bbde6343b92f9851d 2023-02-18 10:01:12,327 INFO [StoreOpener-0a4468ba2137967a0b71fcead817084f-1] regionserver.HStore(310): Store=0a4468ba2137967a0b71fcead817084f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,328 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0a4468ba2137967a0b71fcead817084f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61998787, jitterRate=-0.07614608108997345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:12,376 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0a4468ba2137967a0b71fcead817084f, disabling compactions & flushes 2023-02-18 10:01:12,376 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:12,376 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:12,376 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. after waiting 0 ms 2023-02-18 10:01:12,376 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:12,391 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:12,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:12,399 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,399 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,405 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,407 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:12,409 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1 2023-02-18 10:01:12,409 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bf6eac89746e1f2531d57c2b49dac4 columnFamilyName f1 2023-02-18 10:01:12,427 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/testWithMapReduce=87bf6eac89746e1f2531d57c2b49dac4-2adefbb1e84e4e43b43a99e4865e9ef8 2023-02-18 10:01:12,427 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(310): Store=87bf6eac89746e1f2531d57c2b49dac4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,427 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:12,429 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2 2023-02-18 10:01:12,430 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bf6eac89746e1f2531d57c2b49dac4 columnFamilyName f2 2023-02-18 10:01:12,442 DEBUG [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/testWithMapReduce=87bf6eac89746e1f2531d57c2b49dac4-fc8edbef2f964dba9c775c3270d0635c 2023-02-18 10:01:12,442 INFO [StoreOpener-87bf6eac89746e1f2531d57c2b49dac4-1] regionserver.HStore(310): Store=87bf6eac89746e1f2531d57c2b49dac4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,442 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 87bf6eac89746e1f2531d57c2b49dac4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61085160, jitterRate=-0.0897601842880249}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:12,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 87bf6eac89746e1f2531d57c2b49dac4, disabling compactions & flushes 2023-02-18 10:01:12,485 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:12,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:12,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. after waiting 0 ms 2023-02-18 10:01:12,486 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:12,510 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:12,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:12,519 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,520 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,532 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,537 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:12,539 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1 2023-02-18 10:01:12,540 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed85f164b1809f7b1ecd534d7b00b20c columnFamilyName f1 2023-02-18 10:01:12,552 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/testWithMapReduce=ed85f164b1809f7b1ecd534d7b00b20c-673e02f4896842d5804ef63069a80243 2023-02-18 10:01:12,552 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(310): Store=ed85f164b1809f7b1ecd534d7b00b20c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,552 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:12,553 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2 2023-02-18 10:01:12,554 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed85f164b1809f7b1ecd534d7b00b20c columnFamilyName f2 2023-02-18 10:01:12,561 DEBUG [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/testWithMapReduce=ed85f164b1809f7b1ecd534d7b00b20c-9a969b7c5d2642ff9cb81060f5c148ec 2023-02-18 10:01:12,561 INFO [StoreOpener-ed85f164b1809f7b1ecd534d7b00b20c-1] regionserver.HStore(310): Store=ed85f164b1809f7b1ecd534d7b00b20c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,562 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ed85f164b1809f7b1ecd534d7b00b20c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68242680, jitterRate=0.016895174980163574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:12,599 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ed85f164b1809f7b1ecd534d7b00b20c, disabling compactions & flushes 2023-02-18 10:01:12,599 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:12,599 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:12,599 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. after waiting 0 ms 2023-02-18 10:01:12,599 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:12,610 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:12,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:12,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,618 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,621 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,624 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:12,626 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1 2023-02-18 10:01:12,626 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15875035428cf5fd626bfd148e4ee8d3 columnFamilyName f1 2023-02-18 10:01:12,634 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/testWithMapReduce=15875035428cf5fd626bfd148e4ee8d3-3b812249279b496dbc6f4c61b57f97b3 2023-02-18 10:01:12,634 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(310): Store=15875035428cf5fd626bfd148e4ee8d3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,634 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:12,636 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2 2023-02-18 10:01:12,636 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15875035428cf5fd626bfd148e4ee8d3 columnFamilyName f2 2023-02-18 10:01:12,642 DEBUG [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/testWithMapReduce=15875035428cf5fd626bfd148e4ee8d3-cb0bdc6690c04adeb8d12bc8bc7d304a 2023-02-18 10:01:12,642 INFO [StoreOpener-15875035428cf5fd626bfd148e4ee8d3-1] regionserver.HStore(310): Store=15875035428cf5fd626bfd148e4ee8d3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,642 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 15875035428cf5fd626bfd148e4ee8d3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65751302, jitterRate=-0.020229250192642212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,642 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:12,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 15875035428cf5fd626bfd148e4ee8d3, disabling compactions & flushes 2023-02-18 10:01:12,694 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:12,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:12,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. after waiting 0 ms 2023-02-18 10:01:12,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:12,702 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:12,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:12,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,706 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,708 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,721 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:12,723 DEBUG [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f1 2023-02-18 10:01:12,724 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e7eceef8bb2aa1a832a9f8feb7e8c65 columnFamilyName f1 2023-02-18 10:01:12,725 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(310): Store=9e7eceef8bb2aa1a832a9f8feb7e8c65/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,725 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:12,726 DEBUG [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f2 2023-02-18 10:01:12,726 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e7eceef8bb2aa1a832a9f8feb7e8c65 columnFamilyName f2 2023-02-18 10:01:12,727 INFO [StoreOpener-9e7eceef8bb2aa1a832a9f8feb7e8c65-1] regionserver.HStore(310): Store=9e7eceef8bb2aa1a832a9f8feb7e8c65/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,727 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,727 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9e7eceef8bb2aa1a832a9f8feb7e8c65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73682852, jitterRate=0.09796005487442017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,727 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:12,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9e7eceef8bb2aa1a832a9f8feb7e8c65, disabling compactions & flushes 2023-02-18 10:01:12,768 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:12,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:12,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. after waiting 0 ms 2023-02-18 10:01:12,768 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:12,769 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:12,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:12,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:12,772 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:12,773 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:12,775 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:12,776 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1 2023-02-18 10:01:12,777 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acdeb3bed9da590001464bbee81e47cc columnFamilyName f1 2023-02-18 10:01:12,782 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/testWithMapReduce=acdeb3bed9da590001464bbee81e47cc-26e7b0b0c99c49448db25d221c829d5c 2023-02-18 10:01:12,783 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(310): Store=acdeb3bed9da590001464bbee81e47cc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,783 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:12,784 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2 2023-02-18 10:01:12,784 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acdeb3bed9da590001464bbee81e47cc columnFamilyName f2 2023-02-18 10:01:12,790 DEBUG [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(539): loaded hdfs://localhost:39907/user/jenkins/test-data/17aae7cf-e00f-9963-630c-6ff54f381989/testWithMapReduceMultiRegion/bc8b89f6-762c-487d-a687-f177458452a3/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/testWithMapReduce=acdeb3bed9da590001464bbee81e47cc-8c9816ea97b340efa62ec7b0d1e7727c 2023-02-18 10:01:12,790 INFO [StoreOpener-acdeb3bed9da590001464bbee81e47cc-1] regionserver.HStore(310): Store=acdeb3bed9da590001464bbee81e47cc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:12,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:12,790 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened acdeb3bed9da590001464bbee81e47cc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74893037, jitterRate=0.11599321663379669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:12,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:12,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing acdeb3bed9da590001464bbee81e47cc, disabling compactions & flushes 2023-02-18 10:01:12,820 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:12,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:12,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. after waiting 0 ms 2023-02-18 10:01:12,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:12,823 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:12,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:13,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-18 10:01:13,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-18 10:01:13,690 INFO [Listener at localhost/42661] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 10:01:13,690 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 10:01:13,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-18 10:01:13,703 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714473703"}]},"ts":"1676714473703"} 2023-02-18 10:01:13,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:13,705 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-18 10:01:13,709 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-18 10:01:13,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, UNASSIGN}] 2023-02-18 10:01:13,720 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, UNASSIGN 2023-02-18 10:01:13,720 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, UNASSIGN 2023-02-18 10:01:13,720 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, UNASSIGN 2023-02-18 10:01:13,721 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, UNASSIGN 2023-02-18 10:01:13,721 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, UNASSIGN 2023-02-18 10:01:13,722 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=15875035428cf5fd626bfd148e4ee8d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:13,722 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=acdeb3bed9da590001464bbee81e47cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:13,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473722"}]},"ts":"1676714473722"} 2023-02-18 10:01:13,722 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473722"}]},"ts":"1676714473722"} 2023-02-18 10:01:13,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=87bf6eac89746e1f2531d57c2b49dac4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:13,723 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=672ff14dbb542680a24b060219bc1f2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:13,723 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473723"}]},"ts":"1676714473723"} 2023-02-18 10:01:13,723 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473723"}]},"ts":"1676714473723"} 2023-02-18 10:01:13,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9e7eceef8bb2aa1a832a9f8feb7e8c65, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:13,724 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714473723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473723"}]},"ts":"1676714473723"} 2023-02-18 10:01:13,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=41, state=RUNNABLE; CloseRegionProcedure 15875035428cf5fd626bfd148e4ee8d3, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:13,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=40, state=RUNNABLE; CloseRegionProcedure 87bf6eac89746e1f2531d57c2b49dac4, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:13,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 672ff14dbb542680a24b060219bc1f2c, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:13,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 9e7eceef8bb2aa1a832a9f8feb7e8c65, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:13,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=42, state=RUNNABLE; CloseRegionProcedure acdeb3bed9da590001464bbee81e47cc, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:13,739 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, UNASSIGN 2023-02-18 10:01:13,739 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, UNASSIGN 2023-02-18 10:01:13,739 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, UNASSIGN 2023-02-18 10:01:13,740 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, UNASSIGN 2023-02-18 10:01:13,741 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0a4468ba2137967a0b71fcead817084f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:13,741 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473740"}]},"ts":"1676714473740"} 2023-02-18 10:01:13,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ed85f164b1809f7b1ecd534d7b00b20c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:13,741 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473741"}]},"ts":"1676714473741"} 2023-02-18 10:01:13,741 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=623b475a0d56201ee830d0e9267ae43d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:13,742 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473741"}]},"ts":"1676714473741"} 2023-02-18 10:01:13,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=36, state=RUNNABLE; CloseRegionProcedure 0a4468ba2137967a0b71fcead817084f, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:13,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=38, state=RUNNABLE; CloseRegionProcedure ed85f164b1809f7b1ecd534d7b00b20c, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:13,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=37, state=RUNNABLE; CloseRegionProcedure 623b475a0d56201ee830d0e9267ae43d, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:13,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e3e105fd1debe3e252412be4837fd262, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:13,748 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473747"}]},"ts":"1676714473747"} 2023-02-18 10:01:13,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure e3e105fd1debe3e252412be4837fd262, server=jenkins-hbase4.apache.org,42455,1676714460918}] 2023-02-18 10:01:13,751 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, UNASSIGN 2023-02-18 10:01:13,752 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=45edc51324ca19560f9647702ac14bbe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:13,753 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714473752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714473752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714473752"}]},"ts":"1676714473752"} 2023-02-18 10:01:13,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 45edc51324ca19560f9647702ac14bbe, server=jenkins-hbase4.apache.org,42481,1676714460967}] 2023-02-18 10:01:13,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:13,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:13,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 672ff14dbb542680a24b060219bc1f2c, disabling compactions & flushes 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ed85f164b1809f7b1ecd534d7b00b20c, disabling compactions & flushes 2023-02-18 10:01:13,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:13,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. after waiting 0 ms 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. after waiting 0 ms 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:13,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:13,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:13,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:13,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c. 2023-02-18 10:01:13,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 672ff14dbb542680a24b060219bc1f2c: 2023-02-18 10:01:13,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c. 2023-02-18 10:01:13,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ed85f164b1809f7b1ecd534d7b00b20c: 2023-02-18 10:01:13,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:13,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 623b475a0d56201ee830d0e9267ae43d, disabling compactions & flushes 2023-02-18 10:01:13,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. after waiting 0 ms 2023-02-18 10:01:13,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:13,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=672ff14dbb542680a24b060219bc1f2c, regionState=CLOSED 2023-02-18 10:01:13,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473912"}]},"ts":"1676714473912"} 2023-02-18 10:01:13,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:13,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:13,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing acdeb3bed9da590001464bbee81e47cc, disabling compactions & flushes 2023-02-18 10:01:13,915 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ed85f164b1809f7b1ecd534d7b00b20c, regionState=CLOSED 2023-02-18 10:01:13,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:13,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:13,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. after waiting 0 ms 2023-02-18 10:01:13,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:13,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473915"}]},"ts":"1676714473915"} 2023-02-18 10:01:13,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-18 10:01:13,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 672ff14dbb542680a24b060219bc1f2c, server=jenkins-hbase4.apache.org,42481,1676714460967 in 185 msec 2023-02-18 10:01:13,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=38 2023-02-18 10:01:13,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=38, state=SUCCESS; CloseRegionProcedure ed85f164b1809f7b1ecd534d7b00b20c, server=jenkins-hbase4.apache.org,42455,1676714460918 in 173 msec 2023-02-18 10:01:13,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=672ff14dbb542680a24b060219bc1f2c, UNASSIGN in 208 msec 2023-02-18 10:01:13,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ed85f164b1809f7b1ecd534d7b00b20c, UNASSIGN in 214 msec 2023-02-18 10:01:13,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:13,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d. 2023-02-18 10:01:13,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 623b475a0d56201ee830d0e9267ae43d: 2023-02-18 10:01:13,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:13,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:13,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 45edc51324ca19560f9647702ac14bbe, disabling compactions & flushes 2023-02-18 10:01:13,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:13,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:13,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. after waiting 0 ms 2023-02-18 10:01:13,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:13,940 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=623b475a0d56201ee830d0e9267ae43d, regionState=CLOSED 2023-02-18 10:01:13,940 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473940"}]},"ts":"1676714473940"} 2023-02-18 10:01:13,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=37 2023-02-18 10:01:13,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=37, state=SUCCESS; CloseRegionProcedure 623b475a0d56201ee830d0e9267ae43d, server=jenkins-hbase4.apache.org,42481,1676714460967 in 198 msec 2023-02-18 10:01:13,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:13,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=623b475a0d56201ee830d0e9267ae43d, UNASSIGN in 236 msec 2023-02-18 10:01:13,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc. 2023-02-18 10:01:13,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for acdeb3bed9da590001464bbee81e47cc: 2023-02-18 10:01:13,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:13,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:13,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87bf6eac89746e1f2531d57c2b49dac4, disabling compactions & flushes 2023-02-18 10:01:13,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:13,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:13,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. after waiting 0 ms 2023-02-18 10:01:13,952 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=acdeb3bed9da590001464bbee81e47cc, regionState=CLOSED 2023-02-18 10:01:13,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:13,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473952"}]},"ts":"1676714473952"} 2023-02-18 10:01:13,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 10:01:13,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe. 2023-02-18 10:01:13,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 45edc51324ca19560f9647702ac14bbe: 2023-02-18 10:01:13,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=42 2023-02-18 10:01:13,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=42, state=SUCCESS; CloseRegionProcedure acdeb3bed9da590001464bbee81e47cc, server=jenkins-hbase4.apache.org,42455,1676714460918 in 221 msec 2023-02-18 10:01:13,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:13,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:13,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9e7eceef8bb2aa1a832a9f8feb7e8c65, disabling compactions & flushes 2023-02-18 10:01:13,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:13,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:13,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. after waiting 0 ms 2023-02-18 10:01:13,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:13,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:13,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4. 2023-02-18 10:01:13,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87bf6eac89746e1f2531d57c2b49dac4: 2023-02-18 10:01:13,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=45edc51324ca19560f9647702ac14bbe, regionState=CLOSED 2023-02-18 10:01:13,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=acdeb3bed9da590001464bbee81e47cc, UNASSIGN in 247 msec 2023-02-18 10:01:13,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714473963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473963"}]},"ts":"1676714473963"} 2023-02-18 10:01:13,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:13,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:13,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e3e105fd1debe3e252412be4837fd262, disabling compactions & flushes 2023-02-18 10:01:13,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:13,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:13,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. after waiting 0 ms 2023-02-18 10:01:13,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:13,966 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=87bf6eac89746e1f2531d57c2b49dac4, regionState=CLOSED 2023-02-18 10:01:13,966 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473966"}]},"ts":"1676714473966"} 2023-02-18 10:01:13,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 10:01:13,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65. 2023-02-18 10:01:13,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9e7eceef8bb2aa1a832a9f8feb7e8c65: 2023-02-18 10:01:13,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-18 10:01:13,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=40 2023-02-18 10:01:13,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=40, state=SUCCESS; CloseRegionProcedure 87bf6eac89746e1f2531d57c2b49dac4, server=jenkins-hbase4.apache.org,42455,1676714460918 in 245 msec 2023-02-18 10:01:13,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 45edc51324ca19560f9647702ac14bbe, server=jenkins-hbase4.apache.org,42481,1676714460967 in 217 msec 2023-02-18 10:01:13,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:13,982 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9e7eceef8bb2aa1a832a9f8feb7e8c65, regionState=CLOSED 2023-02-18 10:01:13,982 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714473982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473982"}]},"ts":"1676714473982"} 2023-02-18 10:01:13,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:13,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:13,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 15875035428cf5fd626bfd148e4ee8d3, disabling compactions & flushes 2023-02-18 10:01:13,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:13,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:13,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. after waiting 0 ms 2023-02-18 10:01:13,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:13,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262. 2023-02-18 10:01:13,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e3e105fd1debe3e252412be4837fd262: 2023-02-18 10:01:13,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=45edc51324ca19560f9647702ac14bbe, UNASSIGN in 270 msec 2023-02-18 10:01:13,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=87bf6eac89746e1f2531d57c2b49dac4, UNASSIGN in 270 msec 2023-02-18 10:01:13,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:13,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:13,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0a4468ba2137967a0b71fcead817084f, disabling compactions & flushes 2023-02-18 10:01:13,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:13,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:13,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. after waiting 0 ms 2023-02-18 10:01:13,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:13,993 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e3e105fd1debe3e252412be4837fd262, regionState=CLOSED 2023-02-18 10:01:13,993 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714473993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714473993"}]},"ts":"1676714473993"} 2023-02-18 10:01:13,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-18 10:01:13,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 9e7eceef8bb2aa1a832a9f8feb7e8c65, server=jenkins-hbase4.apache.org,42481,1676714460967 in 259 msec 2023-02-18 10:01:13,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9e7eceef8bb2aa1a832a9f8feb7e8c65, UNASSIGN in 282 msec 2023-02-18 10:01:13,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:14,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3. 2023-02-18 10:01:14,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 15875035428cf5fd626bfd148e4ee8d3: 2023-02-18 10:01:14,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-18 10:01:14,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure e3e105fd1debe3e252412be4837fd262, server=jenkins-hbase4.apache.org,42455,1676714460918 in 245 msec 2023-02-18 10:01:14,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:14,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:14,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f. 2023-02-18 10:01:14,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0a4468ba2137967a0b71fcead817084f: 2023-02-18 10:01:14,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e3e105fd1debe3e252412be4837fd262, UNASSIGN in 290 msec 2023-02-18 10:01:14,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=15875035428cf5fd626bfd148e4ee8d3, regionState=CLOSED 2023-02-18 10:01:14,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714474004"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714474004"}]},"ts":"1676714474004"} 2023-02-18 10:01:14,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:14,008 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0a4468ba2137967a0b71fcead817084f, regionState=CLOSED 2023-02-18 10:01:14,008 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714474008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714474008"}]},"ts":"1676714474008"} 2023-02-18 10:01:14,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:14,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=41 2023-02-18 10:01:14,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=41, state=SUCCESS; CloseRegionProcedure 15875035428cf5fd626bfd148e4ee8d3, server=jenkins-hbase4.apache.org,42481,1676714460967 in 282 msec 2023-02-18 10:01:14,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15875035428cf5fd626bfd148e4ee8d3, UNASSIGN in 299 msec 2023-02-18 10:01:14,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=36 2023-02-18 10:01:14,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=36, state=SUCCESS; CloseRegionProcedure 0a4468ba2137967a0b71fcead817084f, server=jenkins-hbase4.apache.org,42455,1676714460918 in 266 msec 2023-02-18 10:01:14,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-18 10:01:14,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0a4468ba2137967a0b71fcead817084f, UNASSIGN in 302 msec 2023-02-18 10:01:14,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714474015"}]},"ts":"1676714474015"} 2023-02-18 10:01:14,018 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-18 10:01:14,020 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-18 10:01:14,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 329 msec 2023-02-18 10:01:14,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:14,314 INFO [Listener at localhost/42661] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-18 10:01:14,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-18 10:01:14,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:14,330 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:14,332 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:14,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:14,348 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/recovered.edits] 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/recovered.edits] 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/recovered.edits] 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/recovered.edits] 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/recovered.edits] 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/recovered.edits] 2023-02-18 10:01:14,354 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/recovered.edits] 2023-02-18 10:01:14,355 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/recovered.edits] 2023-02-18 10:01:14,372 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/2adefbb1e84e4e43b43a99e4865e9ef8 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/2adefbb1e84e4e43b43a99e4865e9ef8 2023-02-18 10:01:14,376 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/7c660c759a3c4f3ab790419f8e24f6e1 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/7c660c759a3c4f3ab790419f8e24f6e1 2023-02-18 10:01:14,377 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/3b812249279b496dbc6f4c61b57f97b3 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/3b812249279b496dbc6f4c61b57f97b3 2023-02-18 10:01:14,377 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/66cdc6799bd44350a94a80a835ef1c67 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/66cdc6799bd44350a94a80a835ef1c67 2023-02-18 10:01:14,378 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/669afcaeafd54c02996a94d55b8bcc9b to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/669afcaeafd54c02996a94d55b8bcc9b 2023-02-18 10:01:14,379 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/09bd77b1cd49498f8f74fe1a89f300a9 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/09bd77b1cd49498f8f74fe1a89f300a9 2023-02-18 10:01:14,381 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/cb48341da4114730a67ebaca84905f8f to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/cb48341da4114730a67ebaca84905f8f 2023-02-18 10:01:14,383 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/a19154ca8419487f97c1e060ab629fdd to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f1/a19154ca8419487f97c1e060ab629fdd 2023-02-18 10:01:14,387 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/abb7fa9dd8d14c34b9872be320569187 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f1/abb7fa9dd8d14c34b9872be320569187 2023-02-18 10:01:14,387 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/efe5b84b8cfa4d979780e9ff368f3551 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f1/efe5b84b8cfa4d979780e9ff368f3551 2023-02-18 10:01:14,388 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/c171f2a7ebd84fc6aee8f1b35858df32 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f1/c171f2a7ebd84fc6aee8f1b35858df32 2023-02-18 10:01:14,388 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/673e02f4896842d5804ef63069a80243 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f1/673e02f4896842d5804ef63069a80243 2023-02-18 10:01:14,389 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/b5d51ed68fa34952bdd6c8c4f2c6fba8 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f1/b5d51ed68fa34952bdd6c8c4f2c6fba8 2023-02-18 10:01:14,391 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f1/dd9ae7b1e8904d2396c743b1fdeb7fc0 2023-02-18 10:01:14,395 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/recovered.edits/6.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe/recovered.edits/6.seqid 2023-02-18 10:01:14,398 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/45edc51324ca19560f9647702ac14bbe 2023-02-18 10:01:14,398 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:14,403 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/1e716f99e0fd46959f44748ffc88fb0f to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/1e716f99e0fd46959f44748ffc88fb0f 2023-02-18 10:01:14,404 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/32678a1aa4dd4005b627adac1405025e to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/32678a1aa4dd4005b627adac1405025e 2023-02-18 10:01:14,405 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/5b5645f9e71f4a5bbde6343b92f9851d to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/5b5645f9e71f4a5bbde6343b92f9851d 2023-02-18 10:01:14,405 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/9a969b7c5d2642ff9cb81060f5c148ec to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/9a969b7c5d2642ff9cb81060f5c148ec 2023-02-18 10:01:14,406 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/0d53cccdb4ba4e8e99453a42d3bd0727 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/0d53cccdb4ba4e8e99453a42d3bd0727 2023-02-18 10:01:14,407 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/recovered.edits] 2023-02-18 10:01:14,408 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/fc8edbef2f964dba9c775c3270d0635c to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/f2/fc8edbef2f964dba9c775c3270d0635c 2023-02-18 10:01:14,409 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/9c16bc241600434eb5e93bd17acb234d to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/f2/9c16bc241600434eb5e93bd17acb234d 2023-02-18 10:01:14,409 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/cb2a94b6c70749298ca76fa612885480 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/f2/cb2a94b6c70749298ca76fa612885480 2023-02-18 10:01:14,410 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/d66be278828848b4bc4255d6b2cceeb6 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/f2/d66be278828848b4bc4255d6b2cceeb6 2023-02-18 10:01:14,411 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/67725e4fd62849c785b91f1b14cf0d21 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/f2/67725e4fd62849c785b91f1b14cf0d21 2023-02-18 10:01:14,414 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/75f4ff40a571455291ff34d0e66430e6 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/75f4ff40a571455291ff34d0e66430e6 2023-02-18 10:01:14,421 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/7aa7077b7674434ab4f08aa501e0d040 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/7aa7077b7674434ab4f08aa501e0d040 2023-02-18 10:01:14,421 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d/recovered.edits/12.seqid 2023-02-18 10:01:14,422 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4/recovered.edits/12.seqid 2023-02-18 10:01:14,423 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/623b475a0d56201ee830d0e9267ae43d 2023-02-18 10:01:14,423 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:14,424 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/a326f85c7c1d4e528c6de4c62d543025 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/f2/a326f85c7c1d4e528c6de4c62d543025 2023-02-18 10:01:14,424 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c/recovered.edits/12.seqid 2023-02-18 10:01:14,424 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/87bf6eac89746e1f2531d57c2b49dac4 2023-02-18 10:01:14,425 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/cb0bdc6690c04adeb8d12bc8bc7d304a to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/f2/cb0bdc6690c04adeb8d12bc8bc7d304a 2023-02-18 10:01:14,426 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/ed85f164b1809f7b1ecd534d7b00b20c 2023-02-18 10:01:14,426 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/26e7b0b0c99c49448db25d221c829d5c to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/26e7b0b0c99c49448db25d221c829d5c 2023-02-18 10:01:14,426 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262/recovered.edits/12.seqid 2023-02-18 10:01:14,427 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f/recovered.edits/12.seqid 2023-02-18 10:01:14,427 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/e3e105fd1debe3e252412be4837fd262 2023-02-18 10:01:14,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/0a4468ba2137967a0b71fcead817084f 2023-02-18 10:01:14,428 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f1, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/f2, FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/recovered.edits] 2023-02-18 10:01:14,429 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/e5d0e27062284d82848f188dc6e6a5fd to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f1/e5d0e27062284d82848f188dc6e6a5fd 2023-02-18 10:01:14,433 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c/recovered.edits/12.seqid 2023-02-18 10:01:14,434 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3/recovered.edits/12.seqid 2023-02-18 10:01:14,434 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/672ff14dbb542680a24b060219bc1f2c 2023-02-18 10:01:14,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 10:01:14,435 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/15875035428cf5fd626bfd148e4ee8d3 2023-02-18 10:01:14,436 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/8c9816ea97b340efa62ec7b0d1e7727c to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/8c9816ea97b340efa62ec7b0d1e7727c 2023-02-18 10:01:14,438 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/e9888f3b3ab14185b40247cd47fca671 to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/f2/e9888f3b3ab14185b40247cd47fca671 2023-02-18 10:01:14,440 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/recovered.edits/6.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65/recovered.edits/6.seqid 2023-02-18 10:01:14,441 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/9e7eceef8bb2aa1a832a9f8feb7e8c65 2023-02-18 10:01:14,442 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/recovered.edits/12.seqid to hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/archive/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc/recovered.edits/12.seqid 2023-02-18 10:01:14,443 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/.tmp/data/default/testWithMapReduce/acdeb3bed9da590001464bbee81e47cc 2023-02-18 10:01:14,443 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 10:01:14,446 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:14,470 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-18 10:01:14,475 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714474477"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,480 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-18 10:01:14,480 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45edc51324ca19560f9647702ac14bbe, NAME => 'testWithMapReduce,,1676714464750.45edc51324ca19560f9647702ac14bbe.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e3e105fd1debe3e252412be4837fd262, NAME => 'testWithMapReduce,aaa,1676714464750.e3e105fd1debe3e252412be4837fd262.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 0a4468ba2137967a0b71fcead817084f, NAME => 'testWithMapReduce,d\x84\x84,1676714464750.0a4468ba2137967a0b71fcead817084f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 623b475a0d56201ee830d0e9267ae43d, NAME => 'testWithMapReduce,g\xA7\xA7,1676714464750.623b475a0d56201ee830d0e9267ae43d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ed85f164b1809f7b1ecd534d7b00b20c, NAME => 'testWithMapReduce,j\xCA\xCA,1676714464750.ed85f164b1809f7b1ecd534d7b00b20c.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 672ff14dbb542680a24b060219bc1f2c, NAME => 'testWithMapReduce,m\xED\xED,1676714464750.672ff14dbb542680a24b060219bc1f2c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 87bf6eac89746e1f2531d57c2b49dac4, NAME => 'testWithMapReduce,q\x11\x10,1676714464750.87bf6eac89746e1f2531d57c2b49dac4.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 15875035428cf5fd626bfd148e4ee8d3, NAME => 'testWithMapReduce,t43,1676714464750.15875035428cf5fd626bfd148e4ee8d3.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => acdeb3bed9da590001464bbee81e47cc, NAME => 'testWithMapReduce,wWV,1676714464750.acdeb3bed9da590001464bbee81e47cc.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 9e7eceef8bb2aa1a832a9f8feb7e8c65, NAME => 'testWithMapReduce,zz{,1676714464750.9e7eceef8bb2aa1a832a9f8feb7e8c65.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-18 10:01:14,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-18 10:01:14,481 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676714474481"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:14,484 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-18 10:01:14,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:14,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 166 msec 2023-02-18 10:01:14,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41097] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 10:01:14,638 INFO [Listener at localhost/42661] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-18 10:01:14,638 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:14,638 INFO [Listener at localhost/42661] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:14,638 DEBUG [Listener at localhost/42661] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0217176f to 127.0.0.1:52953 2023-02-18 10:01:14,638 DEBUG [Listener at localhost/42661] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:14,639 DEBUG [Listener at localhost/42661] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:14,639 DEBUG [Listener at localhost/42661] util.JVMClusterUtil(257): Found active master hash=1396769909, stopped=false 2023-02-18 10:01:14,639 INFO [Listener at localhost/42661] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:14,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:14,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:14,643 INFO [Listener at localhost/42661] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:14,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:14,643 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:14,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:14,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:14,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:14,645 DEBUG [Listener at localhost/42661] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40039029 to 127.0.0.1:52953 2023-02-18 10:01:14,646 DEBUG [Listener at localhost/42661] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:14,646 INFO [Listener at localhost/42661] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42455,1676714460918' ***** 2023-02-18 10:01:14,647 INFO [Listener at localhost/42661] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:14,647 INFO [Listener at localhost/42661] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42481,1676714460967' ***** 2023-02-18 10:01:14,647 INFO [Listener at localhost/42661] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:14,647 INFO [RS:1;jenkins-hbase4:42481] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:14,647 INFO [RS:1;jenkins-hbase4:42481] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:14,647 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:14,647 INFO [RS:1;jenkins-hbase4:42481] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:14,648 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:14,648 DEBUG [RS:1;jenkins-hbase4:42481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x028c3b90 to 127.0.0.1:52953 2023-02-18 10:01:14,648 DEBUG [RS:1;jenkins-hbase4:42481] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:14,648 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42481,1676714460967; all regions closed. 2023-02-18 10:01:14,651 INFO [RS:0;jenkins-hbase4:42455] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:14,651 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:14,651 INFO [RS:0;jenkins-hbase4:42455] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:14,652 INFO [RS:0;jenkins-hbase4:42455] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:14,652 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(3304): Received CLOSE for a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:14,653 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:14,653 DEBUG [RS:0;jenkins-hbase4:42455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44268468 to 127.0.0.1:52953 2023-02-18 10:01:14,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a3cb202432ad1580fbea89b0c9fb48d9, disabling compactions & flushes 2023-02-18 10:01:14,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:14,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:14,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. after waiting 0 ms 2023-02-18 10:01:14,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:14,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a3cb202432ad1580fbea89b0c9fb48d9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:14,653 DEBUG [RS:0;jenkins-hbase4:42455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:14,654 INFO [RS:0;jenkins-hbase4:42455] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:14,654 INFO [RS:0;jenkins-hbase4:42455] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:14,654 INFO [RS:0;jenkins-hbase4:42455] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:14,655 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:14,655 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 10:01:14,655 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, a3cb202432ad1580fbea89b0c9fb48d9=hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9.} 2023-02-18 10:01:14,657 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1505): Waiting on 1588230740, a3cb202432ad1580fbea89b0c9fb48d9 2023-02-18 10:01:14,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:14,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:14,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:14,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:14,658 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:14,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-18 10:01:14,670 DEBUG [RS:1;jenkins-hbase4:42481] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/oldWALs 2023-02-18 10:01:14,670 INFO [RS:1;jenkins-hbase4:42481] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42481%2C1676714460967:(num 1676714464431) 2023-02-18 10:01:14,670 DEBUG [RS:1;jenkins-hbase4:42481] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:14,671 INFO [RS:1;jenkins-hbase4:42481] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:14,671 INFO [RS:1;jenkins-hbase4:42481] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:14,671 INFO [RS:1;jenkins-hbase4:42481] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:14,671 INFO [RS:1;jenkins-hbase4:42481] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:14,671 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:14,671 INFO [RS:1;jenkins-hbase4:42481] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:14,673 INFO [RS:1;jenkins-hbase4:42481] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42481 2023-02-18 10:01:14,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/.tmp/info/dbcf002cb74a418799e2f779adf28190 2023-02-18 10:01:14,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/.tmp/info/49f99b130adf4594b055910a7b662fab 2023-02-18 10:01:14,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49f99b130adf4594b055910a7b662fab 2023-02-18 10:01:14,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/.tmp/info/dbcf002cb74a418799e2f779adf28190 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/info/dbcf002cb74a418799e2f779adf28190 2023-02-18 10:01:14,723 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:14,732 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:14,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/info/dbcf002cb74a418799e2f779adf28190, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:14,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a3cb202432ad1580fbea89b0c9fb48d9 in 97ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:14,786 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:14,786 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42481,1676714460967 2023-02-18 10:01:14,786 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:14,786 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:14,792 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/.tmp/rep_barrier/56e16af25cf24c7882d76cee9465b5e3 2023-02-18 10:01:14,793 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d56301 rejected from java.util.concurrent.ThreadPoolExecutor@6eae783[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:14,795 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:14,796 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b8500a0 rejected from java.util.concurrent.ThreadPoolExecutor@6eae783[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:14,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/namespace/a3cb202432ad1580fbea89b0c9fb48d9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:14,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:14,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a3cb202432ad1580fbea89b0c9fb48d9: 2023-02-18 10:01:14,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714463823.a3cb202432ad1580fbea89b0c9fb48d9. 2023-02-18 10:01:14,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56e16af25cf24c7882d76cee9465b5e3 2023-02-18 10:01:14,830 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/.tmp/table/4865b6ce875a4715b19f12b059fa97df 2023-02-18 10:01:14,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4865b6ce875a4715b19f12b059fa97df 2023-02-18 10:01:14,845 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/.tmp/info/49f99b130adf4594b055910a7b662fab as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/info/49f99b130adf4594b055910a7b662fab 2023-02-18 10:01:14,853 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49f99b130adf4594b055910a7b662fab 2023-02-18 10:01:14,853 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/info/49f99b130adf4594b055910a7b662fab, entries=30, sequenceid=57, filesize=7.9 K 2023-02-18 10:01:14,854 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/.tmp/rep_barrier/56e16af25cf24c7882d76cee9465b5e3 as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/rep_barrier/56e16af25cf24c7882d76cee9465b5e3 2023-02-18 10:01:14,857 DEBUG [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 10:01:14,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56e16af25cf24c7882d76cee9465b5e3 2023-02-18 10:01:14,861 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/rep_barrier/56e16af25cf24c7882d76cee9465b5e3, entries=10, sequenceid=57, filesize=5.9 K 2023-02-18 10:01:14,862 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/.tmp/table/4865b6ce875a4715b19f12b059fa97df as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/table/4865b6ce875a4715b19f12b059fa97df 2023-02-18 10:01:14,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4865b6ce875a4715b19f12b059fa97df 2023-02-18 10:01:14,870 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/table/4865b6ce875a4715b19f12b059fa97df, entries=13, sequenceid=57, filesize=5.9 K 2023-02-18 10:01:14,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 213ms, sequenceid=57, compaction requested=false 2023-02-18 10:01:14,887 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42481,1676714460967] 2023-02-18 10:01:14,887 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42481,1676714460967; numProcessing=1 2023-02-18 10:01:14,890 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42481,1676714460967 already deleted, retry=false 2023-02-18 10:01:14,890 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42481,1676714460967 expired; onlineServers=1 2023-02-18 10:01:14,896 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-18 10:01:14,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:14,898 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:14,898 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:14,898 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:14,988 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:14,988 INFO [RS:1;jenkins-hbase4:42481] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42481,1676714460967; zookeeper connection closed. 2023-02-18 10:01:14,988 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23669a9a rejected from java.util.concurrent.ThreadPoolExecutor@6eae783[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:14,988 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42481-0x10066e028630002, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:14,988 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@503402ad rejected from java.util.concurrent.ThreadPoolExecutor@6eae783[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:14,989 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2959a34f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2959a34f 2023-02-18 10:01:15,058 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42455,1676714460918; all regions closed. 2023-02-18 10:01:15,065 DEBUG [RS:0;jenkins-hbase4:42455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/oldWALs 2023-02-18 10:01:15,065 INFO [RS:0;jenkins-hbase4:42455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42455%2C1676714460918.meta:.meta(num 1676714463529) 2023-02-18 10:01:15,074 DEBUG [RS:0;jenkins-hbase4:42455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/oldWALs 2023-02-18 10:01:15,074 INFO [RS:0;jenkins-hbase4:42455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42455%2C1676714460918:(num 1676714464319) 2023-02-18 10:01:15,074 DEBUG [RS:0;jenkins-hbase4:42455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:15,074 INFO [RS:0;jenkins-hbase4:42455] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:15,075 INFO [RS:0;jenkins-hbase4:42455] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:15,075 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:15,076 INFO [RS:0;jenkins-hbase4:42455] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42455 2023-02-18 10:01:15,078 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42455,1676714460918 2023-02-18 10:01:15,078 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:15,078 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3aa90903 rejected from java.util.concurrent.ThreadPoolExecutor@3e968a8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:15,081 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42455,1676714460918] 2023-02-18 10:01:15,081 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42455,1676714460918; numProcessing=2 2023-02-18 10:01:15,083 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42455,1676714460918 already deleted, retry=false 2023-02-18 10:01:15,083 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42455,1676714460918 expired; onlineServers=0 2023-02-18 10:01:15,083 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41097,1676714459706' ***** 2023-02-18 10:01:15,083 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:15,084 DEBUG [M:0;jenkins-hbase4:41097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@127c0e4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:15,084 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41097,1676714459706 2023-02-18 10:01:15,084 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41097,1676714459706; all regions closed. 2023-02-18 10:01:15,084 DEBUG [M:0;jenkins-hbase4:41097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:15,084 DEBUG [M:0;jenkins-hbase4:41097] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:15,084 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:15,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714462250] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714462250,5,FailOnTimeoutGroup] 2023-02-18 10:01:15,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714462249] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714462249,5,FailOnTimeoutGroup] 2023-02-18 10:01:15,084 DEBUG [M:0;jenkins-hbase4:41097] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:15,085 INFO [M:0;jenkins-hbase4:41097] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:15,085 INFO [M:0;jenkins-hbase4:41097] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:15,085 INFO [M:0;jenkins-hbase4:41097] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:15,086 DEBUG [M:0;jenkins-hbase4:41097] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:15,086 INFO [M:0;jenkins-hbase4:41097] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:15,088 ERROR [M:0;jenkins-hbase4:41097] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] 2023-02-18 10:01:15,088 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-18 10:01:15,088 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:15,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:15,089 INFO [M:0;jenkins-hbase4:41097] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:15,089 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:15,089 DEBUG [M:0;jenkins-hbase4:41097] zookeeper.ZKUtil(398): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:15,089 WARN [M:0;jenkins-hbase4:41097] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:15,089 INFO [M:0;jenkins-hbase4:41097] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:15,090 INFO [M:0;jenkins-hbase4:41097] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:15,090 DEBUG [M:0;jenkins-hbase4:41097] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:15,090 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:15,090 DEBUG [M:0;jenkins-hbase4:41097] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:15,091 DEBUG [M:0;jenkins-hbase4:41097] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:15,091 DEBUG [M:0;jenkins-hbase4:41097] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:15,091 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.28 KB heapSize=192.19 KB 2023-02-18 10:01:15,112 INFO [M:0;jenkins-hbase4:41097] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.28 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cd5624c32e6f4dd5bc9b3b9b490f179c 2023-02-18 10:01:15,119 DEBUG [M:0;jenkins-hbase4:41097] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cd5624c32e6f4dd5bc9b3b9b490f179c as hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cd5624c32e6f4dd5bc9b3b9b490f179c 2023-02-18 10:01:15,124 INFO [M:0;jenkins-hbase4:41097] regionserver.HStore(1080): Added hdfs://localhost:39907/user/jenkins/test-data/c3e79a27-f465-27f2-aaff-65f2946c9c6c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cd5624c32e6f4dd5bc9b3b9b490f179c, entries=53, sequenceid=357, filesize=10.4 K 2023-02-18 10:01:15,125 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegion(2947): Finished flush of dataSize ~159.28 KB/163106, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=357, compaction requested=false 2023-02-18 10:01:15,127 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:15,127 DEBUG [M:0;jenkins-hbase4:41097] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:15,130 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:15,130 INFO [M:0;jenkins-hbase4:41097] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:15,131 INFO [M:0;jenkins-hbase4:41097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41097 2023-02-18 10:01:15,134 DEBUG [M:0;jenkins-hbase4:41097] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41097,1676714459706 already deleted, retry=false 2023-02-18 10:01:15,182 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:15,182 INFO [RS:0;jenkins-hbase4:42455] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42455,1676714460918; zookeeper connection closed. 2023-02-18 10:01:15,182 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38367ca5 rejected from java.util.concurrent.ThreadPoolExecutor@3e968a8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:15,182 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@394c15dd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@394c15dd 2023-02-18 10:01:15,182 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): regionserver:42455-0x10066e028630001, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:15,182 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40edba91 rejected from java.util.concurrent.ThreadPoolExecutor@3e968a8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:15,182 INFO [Listener at localhost/42661] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:15,282 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:15,282 INFO [M:0;jenkins-hbase4:41097] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41097,1676714459706; zookeeper connection closed. 2023-02-18 10:01:15,282 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c11f82a rejected from java.util.concurrent.ThreadPoolExecutor@56b5c20d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:15,282 DEBUG [Listener at localhost/42661-EventThread] zookeeper.ZKWatcher(600): master:41097-0x10066e028630000, quorum=127.0.0.1:52953, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:15,282 ERROR [Listener at localhost/42661-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68feba4 rejected from java.util.concurrent.ThreadPoolExecutor@56b5c20d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:15,285 WARN [Listener at localhost/42661] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:15,288 INFO [Listener at localhost/42661] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:15,392 WARN [BP-1222718303-172.31.14.131-1676714456381 heartbeating to localhost/127.0.0.1:39907] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:15,392 WARN [BP-1222718303-172.31.14.131-1676714456381 heartbeating to localhost/127.0.0.1:39907] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1222718303-172.31.14.131-1676714456381 (Datanode Uuid 8ab0f0b7-9a1d-41b6-92a7-e0a81530c981) service to localhost/127.0.0.1:39907 2023-02-18 10:01:15,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/dfs/data/data3/current/BP-1222718303-172.31.14.131-1676714456381] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:15,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/dfs/data/data4/current/BP-1222718303-172.31.14.131-1676714456381] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:15,396 WARN [Listener at localhost/42661] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:15,400 INFO [Listener at localhost/42661] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:15,504 WARN [BP-1222718303-172.31.14.131-1676714456381 heartbeating to localhost/127.0.0.1:39907] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:15,504 WARN [BP-1222718303-172.31.14.131-1676714456381 heartbeating to localhost/127.0.0.1:39907] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1222718303-172.31.14.131-1676714456381 (Datanode Uuid 2aa0f3c2-99c5-42ec-aa97-9a91740af3c3) service to localhost/127.0.0.1:39907 2023-02-18 10:01:15,505 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/dfs/data/data1/current/BP-1222718303-172.31.14.131-1676714456381] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:15,505 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/cluster_e0b699f4-b5c9-4452-fd0d-deb93b6a7553/dfs/data/data2/current/BP-1222718303-172.31.14.131-1676714456381] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:15,536 INFO [Listener at localhost/42661] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:15,658 INFO [Listener at localhost/42661] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:15,726 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:15,739 INFO [Listener at localhost/42661] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:39907 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:39907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:39907 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42661 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@324e3fb4 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39907 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:39907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:39907 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41097,1676714459706)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:39907 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=538 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 112) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=9424 (was 11027) 2023-02-18 10:01:15,748 INFO [Listener at localhost/42661] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=170, AvailableMemoryMB=9424 2023-02-18 10:01:15,758 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop.log.dir so I do NOT create it in target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0 2023-02-18 10:01:15,759 WARN [Listener at localhost/42661] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop.tmp.dir so I do NOT create it in target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0 2023-02-18 10:01:15,759 WARN [Listener at localhost/42661] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3bddd921-b0eb-020a-d8d2-e58592d3d711/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 10:01:15,759 DEBUG [Listener at localhost/42661] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb, deleteOnExit=true 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/test.cache.data in system properties and HBase conf 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:01:15,759 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:01:15,760 DEBUG [Listener at localhost/42661] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:15,760 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:01:15,761 INFO [Listener at localhost/42661] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:01:15,765 WARN [Listener at localhost/42661] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:15,766 WARN [Listener at localhost/42661] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:15,813 WARN [Listener at localhost/42661] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:15,815 INFO [Listener at localhost/42661] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:15,819 INFO [Listener at localhost/42661] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/java.io.tmpdir/Jetty_localhost_37999_hdfs____.46bq5d/webapp 2023-02-18 10:01:15,912 INFO [Listener at localhost/42661] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37999 2023-02-18 10:01:15,916 WARN [Listener at localhost/42661] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:15,916 WARN [Listener at localhost/42661] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:15,958 WARN [Listener at localhost/44243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:15,968 WARN [Listener at localhost/44243] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:15,970 WARN [Listener at localhost/44243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:15,971 INFO [Listener at localhost/44243] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:15,976 INFO [Listener at localhost/44243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/java.io.tmpdir/Jetty_localhost_43521_datanode____jv5a64/webapp 2023-02-18 10:01:16,071 INFO [Listener at localhost/44243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43521 2023-02-18 10:01:16,080 WARN [Listener at localhost/42845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:16,097 WARN [Listener at localhost/42845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:16,100 WARN [Listener at localhost/42845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:16,101 INFO [Listener at localhost/42845] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:16,108 INFO [Listener at localhost/42845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/java.io.tmpdir/Jetty_localhost_45985_datanode____x4qofw/webapp 2023-02-18 10:01:16,192 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb9497b203a096e5f: Processing first storage report for DS-51683cad-ea52-45ac-92ce-1c64f788c31c from datanode d12e09d9-a20a-4183-9651-5cb03664cacc 2023-02-18 10:01:16,193 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb9497b203a096e5f: from storage DS-51683cad-ea52-45ac-92ce-1c64f788c31c node DatanodeRegistration(127.0.0.1:46739, datanodeUuid=d12e09d9-a20a-4183-9651-5cb03664cacc, infoPort=44667, infoSecurePort=0, ipcPort=42845, storageInfo=lv=-57;cid=testClusterID;nsid=261925829;c=1676714475768), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 10:01:16,193 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb9497b203a096e5f: Processing first storage report for DS-713a998f-f7ca-4f3b-9c87-7253fc886574 from datanode d12e09d9-a20a-4183-9651-5cb03664cacc 2023-02-18 10:01:16,193 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb9497b203a096e5f: from storage DS-713a998f-f7ca-4f3b-9c87-7253fc886574 node DatanodeRegistration(127.0.0.1:46739, datanodeUuid=d12e09d9-a20a-4183-9651-5cb03664cacc, infoPort=44667, infoSecurePort=0, ipcPort=42845, storageInfo=lv=-57;cid=testClusterID;nsid=261925829;c=1676714475768), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:16,232 INFO [Listener at localhost/42845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45985 2023-02-18 10:01:16,245 WARN [Listener at localhost/40099] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:16,356 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa795e22a20749bef: Processing first storage report for DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8 from datanode 3ef5756d-5ac1-4ba7-80a4-c9c5e75ebb58 2023-02-18 10:01:16,357 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa795e22a20749bef: from storage DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8 node DatanodeRegistration(127.0.0.1:37199, datanodeUuid=3ef5756d-5ac1-4ba7-80a4-c9c5e75ebb58, infoPort=40381, infoSecurePort=0, ipcPort=40099, storageInfo=lv=-57;cid=testClusterID;nsid=261925829;c=1676714475768), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 10:01:16,357 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa795e22a20749bef: Processing first storage report for DS-824f3b2b-1b50-42ce-90fc-d9e74dcdda28 from datanode 3ef5756d-5ac1-4ba7-80a4-c9c5e75ebb58 2023-02-18 10:01:16,357 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa795e22a20749bef: from storage DS-824f3b2b-1b50-42ce-90fc-d9e74dcdda28 node DatanodeRegistration(127.0.0.1:37199, datanodeUuid=3ef5756d-5ac1-4ba7-80a4-c9c5e75ebb58, infoPort=40381, infoSecurePort=0, ipcPort=40099, storageInfo=lv=-57;cid=testClusterID;nsid=261925829;c=1676714475768), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:16,362 DEBUG [Listener at localhost/40099] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0 2023-02-18 10:01:16,369 INFO [Listener at localhost/40099] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/zookeeper_0, clientPort=58440, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:01:16,370 INFO [Listener at localhost/40099] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58440 2023-02-18 10:01:16,370 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,372 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,392 INFO [Listener at localhost/40099] util.FSUtils(479): Created version file at hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e with version=8 2023-02-18 10:01:16,392 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,394 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,395 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/hbase-staging 2023-02-18 10:01:16,397 INFO [Listener at localhost/40099] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:16,398 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,398 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,398 INFO [Listener at localhost/40099] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:16,398 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,398 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:16,398 INFO [Listener at localhost/40099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:16,400 INFO [Listener at localhost/40099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43321 2023-02-18 10:01:16,401 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,402 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,403 INFO [Listener at localhost/40099] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43321 connecting to ZooKeeper ensemble=127.0.0.1:58440 2023-02-18 10:01:16,412 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:433210x0, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:16,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43321-0x10066e06d130000 connected 2023-02-18 10:01:16,439 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:16,439 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:16,440 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:16,440 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43321 2023-02-18 10:01:16,441 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43321 2023-02-18 10:01:16,443 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43321 2023-02-18 10:01:16,443 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43321 2023-02-18 10:01:16,444 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43321 2023-02-18 10:01:16,444 INFO [Listener at localhost/40099] master.HMaster(444): hbase.rootdir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e, hbase.cluster.distributed=false 2023-02-18 10:01:16,460 INFO [Listener at localhost/40099] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:16,460 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,460 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,461 INFO [Listener at localhost/40099] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:16,461 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,461 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:16,461 INFO [Listener at localhost/40099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:16,464 INFO [Listener at localhost/40099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45301 2023-02-18 10:01:16,464 INFO [Listener at localhost/40099] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:16,468 DEBUG [Listener at localhost/40099] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:16,468 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,469 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,470 INFO [Listener at localhost/40099] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45301 connecting to ZooKeeper ensemble=127.0.0.1:58440 2023-02-18 10:01:16,474 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:453010x0, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:16,474 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): regionserver:453010x0, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:16,475 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): regionserver:453010x0, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:16,475 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): regionserver:453010x0, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:16,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45301-0x10066e06d130001 connected 2023-02-18 10:01:16,480 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45301 2023-02-18 10:01:16,483 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45301 2023-02-18 10:01:16,483 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45301 2023-02-18 10:01:16,484 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45301 2023-02-18 10:01:16,484 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45301 2023-02-18 10:01:16,499 INFO [Listener at localhost/40099] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:16,499 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,499 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,499 INFO [Listener at localhost/40099] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:16,500 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:16,500 INFO [Listener at localhost/40099] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:16,500 INFO [Listener at localhost/40099] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:16,504 INFO [Listener at localhost/40099] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44613 2023-02-18 10:01:16,505 INFO [Listener at localhost/40099] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:16,506 DEBUG [Listener at localhost/40099] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:16,506 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,507 INFO [Listener at localhost/40099] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,508 INFO [Listener at localhost/40099] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44613 connecting to ZooKeeper ensemble=127.0.0.1:58440 2023-02-18 10:01:16,513 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:446130x0, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:16,514 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): regionserver:446130x0, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:16,514 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): regionserver:446130x0, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:16,515 DEBUG [Listener at localhost/40099] zookeeper.ZKUtil(164): regionserver:446130x0, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:16,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44613-0x10066e06d130002 connected 2023-02-18 10:01:16,516 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44613 2023-02-18 10:01:16,517 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44613 2023-02-18 10:01:16,520 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44613 2023-02-18 10:01:16,521 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44613 2023-02-18 10:01:16,523 DEBUG [Listener at localhost/40099] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44613 2023-02-18 10:01:16,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,527 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:16,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,529 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:16,529 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:16,529 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:16,529 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:16,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43321,1676714476397 from backup master directory 2023-02-18 10:01:16,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:16,532 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,532 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:16,532 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:16,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/hbase.id with ID: 996f1c69-de6b-4502-8063-75dbe4fa9e47 2023-02-18 10:01:16,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:16,565 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5823e739 to 127.0.0.1:58440 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:16,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30444b72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:16,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:16,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:16,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:16,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store-tmp 2023-02-18 10:01:16,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:16,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:16,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:16,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:16,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:16,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:16,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:16,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:16,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/WALs/jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43321%2C1676714476397, suffix=, logDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/WALs/jenkins-hbase4.apache.org,43321,1676714476397, archiveDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:16,620 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK] 2023-02-18 10:01:16,621 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK] 2023-02-18 10:01:16,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/WALs/jenkins-hbase4.apache.org,43321,1676714476397/jenkins-hbase4.apache.org%2C43321%2C1676714476397.1676714476602 2023-02-18 10:01:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK]] 2023-02-18 10:01:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:16,626 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:16,628 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:16,628 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:16,629 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:16,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:16,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:16,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:16,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:16,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73330749, jitterRate=0.09271331131458282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:16,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:16,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:16,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:16,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:16,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:16,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 10:01:16,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 10:01:16,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:16,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:16,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:16,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:16,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:16,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:16,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:16,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:16,659 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:16,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:16,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:16,662 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:16,662 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:16,662 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,662 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:16,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43321,1676714476397, sessionid=0x10066e06d130000, setting cluster-up flag (Was=false) 2023-02-18 10:01:16,668 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:16,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,676 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:16,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:16,682 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.hbase-snapshot/.tmp 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:16,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:16,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714506697 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:16,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:16,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:16,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:16,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:16,701 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:16,701 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:16,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:16,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:16,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714476702,5,FailOnTimeoutGroup] 2023-02-18 10:01:16,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714476703,5,FailOnTimeoutGroup] 2023-02-18 10:01:16,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:16,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,703 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:16,716 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:16,717 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:16,717 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e 2023-02-18 10:01:16,726 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:16,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:16,728 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/info 2023-02-18 10:01:16,729 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:16,729 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(952): ClusterId : 996f1c69-de6b-4502-8063-75dbe4fa9e47 2023-02-18 10:01:16,729 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(952): ClusterId : 996f1c69-de6b-4502-8063-75dbe4fa9e47 2023-02-18 10:01:16,729 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:16,729 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:16,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:16,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:16,731 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:16,731 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:16,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:16,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:16,732 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:16,732 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:16,732 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:16,732 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:16,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/table 2023-02-18 10:01:16,733 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:16,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:16,735 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:16,735 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:16,735 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740 2023-02-18 10:01:16,737 DEBUG [RS:1;jenkins-hbase4:44613] zookeeper.ReadOnlyZKClient(139): Connect 0x4dd6f68f to 127.0.0.1:58440 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:16,737 DEBUG [RS:0;jenkins-hbase4:45301] zookeeper.ReadOnlyZKClient(139): Connect 0x6537bbbe to 127.0.0.1:58440 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:16,737 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740 2023-02-18 10:01:16,742 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:16,743 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:16,745 DEBUG [RS:1;jenkins-hbase4:44613] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43110145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:16,745 DEBUG [RS:1;jenkins-hbase4:44613] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472e9dff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:16,745 DEBUG [RS:0;jenkins-hbase4:45301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bf04968, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:16,745 DEBUG [RS:0;jenkins-hbase4:45301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fcfd0ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:16,750 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:16,750 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75069845, jitterRate=0.11862786114215851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:16,750 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:16,750 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:16,750 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:16,751 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:16,751 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:16,751 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:16,751 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:16,751 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:16,754 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45301 2023-02-18 10:01:16,754 INFO [RS:0;jenkins-hbase4:45301] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:16,754 INFO [RS:0;jenkins-hbase4:45301] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:16,754 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:16,755 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43321,1676714476397 with isa=jenkins-hbase4.apache.org/172.31.14.131:45301, startcode=1676714476460 2023-02-18 10:01:16,755 DEBUG [RS:0;jenkins-hbase4:45301] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:16,755 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:16,755 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:16,755 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44613 2023-02-18 10:01:16,755 INFO [RS:1;jenkins-hbase4:44613] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:16,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:16,755 INFO [RS:1;jenkins-hbase4:44613] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:16,756 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:16,758 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43321,1676714476397 with isa=jenkins-hbase4.apache.org/172.31.14.131:44613, startcode=1676714476499 2023-02-18 10:01:16,758 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:16,758 DEBUG [RS:1;jenkins-hbase4:44613] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:16,759 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39365, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:16,760 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:16,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,765 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e 2023-02-18 10:01:16,766 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44243 2023-02-18 10:01:16,766 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:16,766 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53759, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:16,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,767 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e 2023-02-18 10:01:16,767 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44243 2023-02-18 10:01:16,767 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:16,767 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:16,772 DEBUG [RS:0;jenkins-hbase4:45301] zookeeper.ZKUtil(162): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45301,1676714476460] 2023-02-18 10:01:16,772 WARN [RS:0;jenkins-hbase4:45301] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:16,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44613,1676714476499] 2023-02-18 10:01:16,772 INFO [RS:0;jenkins-hbase4:45301] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:16,772 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,773 DEBUG [RS:1;jenkins-hbase4:44613] zookeeper.ZKUtil(162): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,773 WARN [RS:1;jenkins-hbase4:44613] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:16,773 INFO [RS:1;jenkins-hbase4:44613] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:16,773 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,779 DEBUG [RS:1;jenkins-hbase4:44613] zookeeper.ZKUtil(162): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,779 DEBUG [RS:0;jenkins-hbase4:45301] zookeeper.ZKUtil(162): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,780 DEBUG [RS:1;jenkins-hbase4:44613] zookeeper.ZKUtil(162): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,780 DEBUG [RS:0;jenkins-hbase4:45301] zookeeper.ZKUtil(162): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,781 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:16,781 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:16,781 INFO [RS:0;jenkins-hbase4:45301] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:16,781 INFO [RS:1;jenkins-hbase4:44613] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:16,784 INFO [RS:0;jenkins-hbase4:45301] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:16,788 INFO [RS:1;jenkins-hbase4:44613] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:16,788 INFO [RS:0;jenkins-hbase4:45301] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:16,788 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,788 INFO [RS:1;jenkins-hbase4:44613] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:16,788 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,790 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:16,791 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:16,793 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,793 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,793 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,793 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,793 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,793 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:0;jenkins-hbase4:45301] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,794 DEBUG [RS:1;jenkins-hbase4:44613] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:16,798 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,798 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,798 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,798 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,798 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,798 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,809 INFO [RS:0;jenkins-hbase4:45301] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:16,809 INFO [RS:1;jenkins-hbase4:44613] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:16,809 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45301,1676714476460-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,809 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44613,1676714476499-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:16,823 INFO [RS:0;jenkins-hbase4:45301] regionserver.Replication(203): jenkins-hbase4.apache.org,45301,1676714476460 started 2023-02-18 10:01:16,823 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45301,1676714476460, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45301, sessionid=0x10066e06d130001 2023-02-18 10:01:16,823 INFO [RS:1;jenkins-hbase4:44613] regionserver.Replication(203): jenkins-hbase4.apache.org,44613,1676714476499 started 2023-02-18 10:01:16,823 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:16,823 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44613,1676714476499, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44613, sessionid=0x10066e06d130002 2023-02-18 10:01:16,823 DEBUG [RS:0;jenkins-hbase4:45301] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,823 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:16,823 DEBUG [RS:0;jenkins-hbase4:45301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45301,1676714476460' 2023-02-18 10:01:16,824 DEBUG [RS:0;jenkins-hbase4:45301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:16,823 DEBUG [RS:1;jenkins-hbase4:44613] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,824 DEBUG [RS:1;jenkins-hbase4:44613] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44613,1676714476499' 2023-02-18 10:01:16,824 DEBUG [RS:1;jenkins-hbase4:44613] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:16,824 DEBUG [RS:0;jenkins-hbase4:45301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:16,824 DEBUG [RS:1;jenkins-hbase4:44613] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:16,824 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:16,824 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:16,824 DEBUG [RS:0;jenkins-hbase4:45301] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:16,825 DEBUG [RS:0;jenkins-hbase4:45301] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45301,1676714476460' 2023-02-18 10:01:16,825 DEBUG [RS:0;jenkins-hbase4:45301] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:16,824 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:16,825 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:16,825 DEBUG [RS:1;jenkins-hbase4:44613] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:16,825 DEBUG [RS:1;jenkins-hbase4:44613] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44613,1676714476499' 2023-02-18 10:01:16,825 DEBUG [RS:1;jenkins-hbase4:44613] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:16,825 DEBUG [RS:0;jenkins-hbase4:45301] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:16,825 DEBUG [RS:1;jenkins-hbase4:44613] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:16,825 DEBUG [RS:0;jenkins-hbase4:45301] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:16,825 INFO [RS:0;jenkins-hbase4:45301] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:16,825 INFO [RS:0;jenkins-hbase4:45301] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:16,826 DEBUG [RS:1;jenkins-hbase4:44613] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:16,826 INFO [RS:1;jenkins-hbase4:44613] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:16,826 INFO [RS:1;jenkins-hbase4:44613] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:16,911 DEBUG [jenkins-hbase4:43321] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:16,911 DEBUG [jenkins-hbase4:43321] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:16,913 DEBUG [jenkins-hbase4:43321] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:16,913 DEBUG [jenkins-hbase4:43321] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:16,913 DEBUG [jenkins-hbase4:43321] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:16,914 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44613,1676714476499, state=OPENING 2023-02-18 10:01:16,915 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:16,917 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:16,917 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:16,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:17,071 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:17,071 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:17,074 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:17,079 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:17,079 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:17,081 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44613%2C1676714476499.meta, suffix=.meta, logDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,44613,1676714476499, archiveDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/oldWALs, maxLogs=32 2023-02-18 10:01:17,096 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK] 2023-02-18 10:01:17,096 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK] 2023-02-18 10:01:17,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,44613,1676714476499/jenkins-hbase4.apache.org%2C44613%2C1676714476499.meta.1676714477082.meta 2023-02-18 10:01:17,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK]] 2023-02-18 10:01:17,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:17,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:17,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:17,100 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:17,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:17,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:17,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:17,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:17,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/info 2023-02-18 10:01:17,103 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/info 2023-02-18 10:01:17,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:17,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:17,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:17,105 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:17,105 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:17,105 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:17,106 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:17,106 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:17,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/table 2023-02-18 10:01:17,107 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/table 2023-02-18 10:01:17,107 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:17,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:17,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740 2023-02-18 10:01:17,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740 2023-02-18 10:01:17,111 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:17,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:17,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62786422, jitterRate=-0.06440940499305725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:17,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:17,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714477071 2023-02-18 10:01:17,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:17,119 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:17,120 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44613,1676714476499, state=OPEN 2023-02-18 10:01:17,121 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:17,121 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:17,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:17,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44613,1676714476499 in 204 msec 2023-02-18 10:01:17,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:17,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 368 msec 2023-02-18 10:01:17,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 443 msec 2023-02-18 10:01:17,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714477127, completionTime=-1 2023-02-18 10:01:17,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:17,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:17,130 DEBUG [hconnection-0x6cbd77f3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:17,132 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58364, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:17,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:17,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714537134 2023-02-18 10:01:17,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714597134 2023-02-18 10:01:17,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43321,1676714476397-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43321,1676714476397-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43321,1676714476397-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43321, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:17,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:17,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:17,143 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:17,144 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:17,145 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:17,147 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/hbase/namespace/d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,147 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/hbase/namespace/d77c02c173785f38c9817e40046d2213 empty. 2023-02-18 10:01:17,148 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/hbase/namespace/d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:17,164 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:17,165 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d77c02c173785f38c9817e40046d2213, NAME => 'hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d77c02c173785f38c9817e40046d2213, disabling compactions & flushes 2023-02-18 10:01:17,174 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. after waiting 0 ms 2023-02-18 10:01:17,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,174 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,174 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d77c02c173785f38c9817e40046d2213: 2023-02-18 10:01:17,177 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:17,178 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714477178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714477178"}]},"ts":"1676714477178"} 2023-02-18 10:01:17,182 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:17,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:17,183 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714477183"}]},"ts":"1676714477183"} 2023-02-18 10:01:17,184 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:17,187 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:17,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:17,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:17,188 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:17,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d77c02c173785f38c9817e40046d2213, ASSIGN}] 2023-02-18 10:01:17,191 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d77c02c173785f38c9817e40046d2213, ASSIGN 2023-02-18 10:01:17,192 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d77c02c173785f38c9817e40046d2213, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44613,1676714476499; forceNewPlan=false, retain=false 2023-02-18 10:01:17,342 INFO [jenkins-hbase4:43321] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:17,343 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d77c02c173785f38c9817e40046d2213, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:17,344 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714477343"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714477343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714477343"}]},"ts":"1676714477343"} 2023-02-18 10:01:17,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d77c02c173785f38c9817e40046d2213, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:17,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,505 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44613%2C1676714476499, suffix=, logDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,44613,1676714476499, archiveDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/oldWALs, maxLogs=32 2023-02-18 10:01:17,522 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK] 2023-02-18 10:01:17,524 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK] 2023-02-18 10:01:17,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,44613,1676714476499/jenkins-hbase4.apache.org%2C44613%2C1676714476499.1676714477506 2023-02-18 10:01:17,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK], DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK]] 2023-02-18 10:01:17,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d77c02c173785f38c9817e40046d2213, NAME => 'hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:17,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,580 INFO [StoreOpener-d77c02c173785f38c9817e40046d2213-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,582 DEBUG [StoreOpener-d77c02c173785f38c9817e40046d2213-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/info 2023-02-18 10:01:17,582 DEBUG [StoreOpener-d77c02c173785f38c9817e40046d2213-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/info 2023-02-18 10:01:17,582 INFO [StoreOpener-d77c02c173785f38c9817e40046d2213-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d77c02c173785f38c9817e40046d2213 columnFamilyName info 2023-02-18 10:01:17,583 INFO [StoreOpener-d77c02c173785f38c9817e40046d2213-1] regionserver.HStore(310): Store=d77c02c173785f38c9817e40046d2213/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:17,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:17,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:17,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d77c02c173785f38c9817e40046d2213; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59264694, jitterRate=-0.11688724160194397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:17,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d77c02c173785f38c9817e40046d2213: 2023-02-18 10:01:17,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213., pid=6, masterSystemTime=1676714477498 2023-02-18 10:01:17,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,593 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:17,593 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d77c02c173785f38c9817e40046d2213, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:17,593 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714477593"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714477593"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714477593"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714477593"}]},"ts":"1676714477593"} 2023-02-18 10:01:17,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:17,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d77c02c173785f38c9817e40046d2213, server=jenkins-hbase4.apache.org,44613,1676714476499 in 249 msec 2023-02-18 10:01:17,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:17,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d77c02c173785f38c9817e40046d2213, ASSIGN in 409 msec 2023-02-18 10:01:17,600 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:17,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714477600"}]},"ts":"1676714477600"} 2023-02-18 10:01:17,601 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:17,604 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:17,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 463 msec 2023-02-18 10:01:17,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:17,678 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:17,678 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:17,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:17,692 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:17,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-18 10:01:17,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:17,713 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:17,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-18 10:01:17,729 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:17,732 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:17,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.200sec 2023-02-18 10:01:17,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:17,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:17,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:17,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43321,1676714476397-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:17,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43321,1676714476397-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:17,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:17,826 DEBUG [Listener at localhost/40099] zookeeper.ReadOnlyZKClient(139): Connect 0x08ba379c to 127.0.0.1:58440 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:17,830 INFO [RS:0;jenkins-hbase4:45301] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45301%2C1676714476460, suffix=, logDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,45301,1676714476460, archiveDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/oldWALs, maxLogs=32 2023-02-18 10:01:17,831 DEBUG [Listener at localhost/40099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@339d12b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:17,833 DEBUG [hconnection-0x4d3db339-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:17,839 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58368, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:17,841 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:17,841 DEBUG [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:17,843 DEBUG [Listener at localhost/40099] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:17,846 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54578, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:17,847 INFO [Listener at localhost/40099] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 10:01:17,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 10:01:17,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:17,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:54578 deadline: 1676714537848, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 10:01:17,851 INFO [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 10:01:17,852 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK] 2023-02-18 10:01:17,852 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK] 2023-02-18 10:01:17,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:17,857 INFO [RS:0;jenkins-hbase4:45301] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/WALs/jenkins-hbase4.apache.org,45301,1676714476460/jenkins-hbase4.apache.org%2C45301%2C1676714476460.1676714477830 2023-02-18 10:01:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 10:01:17,860 DEBUG [RS:0;jenkins-hbase4:45301] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46739,DS-51683cad-ea52-45ac-92ce-1c64f788c31c,DISK], DatanodeInfoWithStorage[127.0.0.1:37199,DS-e08ced27-939a-4b3f-b6e0-071ce76c15a8,DISK]] 2023-02-18 10:01:17,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:17,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 10:01:17,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:17,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:17,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:17,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:17,870 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:17,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071 empty. 2023-02-18 10:01:17,872 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5 empty. 2023-02-18 10:01:17,872 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468 empty. 2023-02-18 10:01:17,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6 empty. 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552 empty. 2023-02-18 10:01:17,873 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06 empty. 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9 empty. 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a empty. 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7 empty. 2023-02-18 10:01:17,874 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:17,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:17,875 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:17,875 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:17,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d empty. 2023-02-18 10:01:17,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:17,875 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 10:01:17,891 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:17,892 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5c81644f06fc3bea32af1c4819e61071, NAME => 'testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,892 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 413dcc3a5721aac783af6ee6ba69f468, NAME => 'testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,893 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => db63ae0323291aea1a5456851ff123a5, NAME => 'testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,908 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,908 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,908 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5c81644f06fc3bea32af1c4819e61071, disabling compactions & flushes 2023-02-18 10:01:17,908 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 413dcc3a5721aac783af6ee6ba69f468, disabling compactions & flushes 2023-02-18 10:01:17,908 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:17,909 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. after waiting 0 ms 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. after waiting 0 ms 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:17,909 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:17,909 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:17,909 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:17,910 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1a2f612a24cc43b17fcf44ac06b96e06, NAME => 'testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,910 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4e4618e0888ab5ba8745526cf8a075d6, NAME => 'testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,912 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,912 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing db63ae0323291aea1a5456851ff123a5, disabling compactions & flushes 2023-02-18 10:01:17,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:17,912 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:17,912 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. after waiting 0 ms 2023-02-18 10:01:17,912 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:17,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:17,912 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:17,913 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6aaa0cc38e6f1bd43891541e91b24552, NAME => 'testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1a2f612a24cc43b17fcf44ac06b96e06, disabling compactions & flushes 2023-02-18 10:01:17,925 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:17,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:17,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. after waiting 0 ms 2023-02-18 10:01:17,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:17,925 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:17,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:17,925 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0d48ab80dab6d54367018d48a3afced9, NAME => 'testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4e4618e0888ab5ba8745526cf8a075d6, disabling compactions & flushes 2023-02-18 10:01:17,926 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:17,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:17,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. after waiting 0 ms 2023-02-18 10:01:17,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:17,926 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:17,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:17,927 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3c6c6b5cbdbb19e67171577c77eca03a, NAME => 'testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 0d48ab80dab6d54367018d48a3afced9, disabling compactions & flushes 2023-02-18 10:01:17,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:17,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:17,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. after waiting 0 ms 2023-02-18 10:01:17,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:17,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:17,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:17,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b3a018163b86c17a0f69d59a6b8c54e7, NAME => 'testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3c6c6b5cbdbb19e67171577c77eca03a, disabling compactions & flushes 2023-02-18 10:01:17,935 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:17,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:17,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. after waiting 0 ms 2023-02-18 10:01:17,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:17,935 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:17,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:17,935 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 10b51df27a03dead14dd2735ddaf817d, NAME => 'testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.tmp 2023-02-18 10:01:17,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b3a018163b86c17a0f69d59a6b8c54e7, disabling compactions & flushes 2023-02-18 10:01:17,940 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:17,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:17,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. after waiting 0 ms 2023-02-18 10:01:17,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:17,940 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:17,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:17,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:17,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 10b51df27a03dead14dd2735ddaf817d, disabling compactions & flushes 2023-02-18 10:01:17,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:17,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:17,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. after waiting 0 ms 2023-02-18 10:01:17,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:17,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:17,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:17,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:18,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:18,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 6aaa0cc38e6f1bd43891541e91b24552, disabling compactions & flushes 2023-02-18 10:01:18,328 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. after waiting 0 ms 2023-02-18 10:01:18,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,328 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,328 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:18,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:18,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714478332"}]},"ts":"1676714478332"} 2023-02-18 10:01:18,336 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 10:01:18,337 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:18,337 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714478337"}]},"ts":"1676714478337"} 2023-02-18 10:01:18,339 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 10:01:18,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:18,352 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:18,352 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:18,352 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:18,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5c81644f06fc3bea32af1c4819e61071, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=413dcc3a5721aac783af6ee6ba69f468, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=db63ae0323291aea1a5456851ff123a5, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1a2f612a24cc43b17fcf44ac06b96e06, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e4618e0888ab5ba8745526cf8a075d6, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6aaa0cc38e6f1bd43891541e91b24552, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0d48ab80dab6d54367018d48a3afced9, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c6c6b5cbdbb19e67171577c77eca03a, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b3a018163b86c17a0f69d59a6b8c54e7, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=10b51df27a03dead14dd2735ddaf817d, ASSIGN}] 2023-02-18 10:01:18,355 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=10b51df27a03dead14dd2735ddaf817d, ASSIGN 2023-02-18 10:01:18,355 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c6c6b5cbdbb19e67171577c77eca03a, ASSIGN 2023-02-18 10:01:18,355 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b3a018163b86c17a0f69d59a6b8c54e7, ASSIGN 2023-02-18 10:01:18,355 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0d48ab80dab6d54367018d48a3afced9, ASSIGN 2023-02-18 10:01:18,356 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6aaa0cc38e6f1bd43891541e91b24552, ASSIGN 2023-02-18 10:01:18,356 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=10b51df27a03dead14dd2735ddaf817d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44613,1676714476499; forceNewPlan=false, retain=false 2023-02-18 10:01:18,357 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0d48ab80dab6d54367018d48a3afced9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45301,1676714476460; forceNewPlan=false, retain=false 2023-02-18 10:01:18,357 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b3a018163b86c17a0f69d59a6b8c54e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45301,1676714476460; forceNewPlan=false, retain=false 2023-02-18 10:01:18,357 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3c6c6b5cbdbb19e67171577c77eca03a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44613,1676714476499; forceNewPlan=false, retain=false 2023-02-18 10:01:18,357 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6aaa0cc38e6f1bd43891541e91b24552, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45301,1676714476460; forceNewPlan=false, retain=false 2023-02-18 10:01:18,357 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e4618e0888ab5ba8745526cf8a075d6, ASSIGN 2023-02-18 10:01:18,358 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1a2f612a24cc43b17fcf44ac06b96e06, ASSIGN 2023-02-18 10:01:18,358 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=db63ae0323291aea1a5456851ff123a5, ASSIGN 2023-02-18 10:01:18,358 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=413dcc3a5721aac783af6ee6ba69f468, ASSIGN 2023-02-18 10:01:18,359 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5c81644f06fc3bea32af1c4819e61071, ASSIGN 2023-02-18 10:01:18,359 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4e4618e0888ab5ba8745526cf8a075d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44613,1676714476499; forceNewPlan=false, retain=false 2023-02-18 10:01:18,359 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1a2f612a24cc43b17fcf44ac06b96e06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45301,1676714476460; forceNewPlan=false, retain=false 2023-02-18 10:01:18,359 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=db63ae0323291aea1a5456851ff123a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44613,1676714476499; forceNewPlan=false, retain=false 2023-02-18 10:01:18,359 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5c81644f06fc3bea32af1c4819e61071, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45301,1676714476460; forceNewPlan=false, retain=false 2023-02-18 10:01:18,360 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=413dcc3a5721aac783af6ee6ba69f468, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44613,1676714476499; forceNewPlan=false, retain=false 2023-02-18 10:01:18,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:18,507 INFO [jenkins-hbase4:43321] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 10:01:18,511 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b3a018163b86c17a0f69d59a6b8c54e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,511 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0d48ab80dab6d54367018d48a3afced9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,511 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5c81644f06fc3bea32af1c4819e61071, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6aaa0cc38e6f1bd43891541e91b24552, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,511 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714478511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478511"}]},"ts":"1676714478511"} 2023-02-18 10:01:18,511 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1a2f612a24cc43b17fcf44ac06b96e06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478511"}]},"ts":"1676714478511"} 2023-02-18 10:01:18,512 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478511"}]},"ts":"1676714478511"} 2023-02-18 10:01:18,511 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478511"}]},"ts":"1676714478511"} 2023-02-18 10:01:18,511 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478511"}]},"ts":"1676714478511"} 2023-02-18 10:01:18,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 5c81644f06fc3bea32af1c4819e61071, server=jenkins-hbase4.apache.org,45301,1676714476460}] 2023-02-18 10:01:18,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 6aaa0cc38e6f1bd43891541e91b24552, server=jenkins-hbase4.apache.org,45301,1676714476460}] 2023-02-18 10:01:18,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure 1a2f612a24cc43b17fcf44ac06b96e06, server=jenkins-hbase4.apache.org,45301,1676714476460}] 2023-02-18 10:01:18,518 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=413dcc3a5721aac783af6ee6ba69f468, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,519 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478518"}]},"ts":"1676714478518"} 2023-02-18 10:01:18,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure 0d48ab80dab6d54367018d48a3afced9, server=jenkins-hbase4.apache.org,45301,1676714476460}] 2023-02-18 10:01:18,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure b3a018163b86c17a0f69d59a6b8c54e7, server=jenkins-hbase4.apache.org,45301,1676714476460}] 2023-02-18 10:01:18,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure 413dcc3a5721aac783af6ee6ba69f468, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:18,529 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=10b51df27a03dead14dd2735ddaf817d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,529 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714478527"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478527"}]},"ts":"1676714478527"} 2023-02-18 10:01:18,531 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=db63ae0323291aea1a5456851ff123a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,531 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478531"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478531"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478531"}]},"ts":"1676714478531"} 2023-02-18 10:01:18,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 10b51df27a03dead14dd2735ddaf817d, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:18,532 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3c6c6b5cbdbb19e67171577c77eca03a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,532 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478532"}]},"ts":"1676714478532"} 2023-02-18 10:01:18,533 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4e4618e0888ab5ba8745526cf8a075d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,533 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714478533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714478533"}]},"ts":"1676714478533"} 2023-02-18 10:01:18,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 3c6c6b5cbdbb19e67171577c77eca03a, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:18,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure 4e4618e0888ab5ba8745526cf8a075d6, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:18,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure db63ae0323291aea1a5456851ff123a5, server=jenkins-hbase4.apache.org,44613,1676714476499}] 2023-02-18 10:01:18,666 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,667 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:18,670 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:18,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:18,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1a2f612a24cc43b17fcf44ac06b96e06, NAME => 'testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 10:01:18,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,680 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,681 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1 2023-02-18 10:01:18,682 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1 2023-02-18 10:01:18,682 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a2f612a24cc43b17fcf44ac06b96e06 columnFamilyName f1 2023-02-18 10:01:18,683 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(310): Store=1a2f612a24cc43b17fcf44ac06b96e06/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,683 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,685 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2 2023-02-18 10:01:18,685 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2 2023-02-18 10:01:18,685 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a2f612a24cc43b17fcf44ac06b96e06 columnFamilyName f2 2023-02-18 10:01:18,686 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(310): Store=1a2f612a24cc43b17fcf44ac06b96e06/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:18,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c6c6b5cbdbb19e67171577c77eca03a, NAME => 'testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 10:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,688 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,690 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1 2023-02-18 10:01:18,690 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1 2023-02-18 10:01:18,690 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c6c6b5cbdbb19e67171577c77eca03a columnFamilyName f1 2023-02-18 10:01:18,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,691 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(310): Store=3c6c6b5cbdbb19e67171577c77eca03a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,691 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:18,693 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2 2023-02-18 10:01:18,693 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2 2023-02-18 10:01:18,693 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c6c6b5cbdbb19e67171577c77eca03a columnFamilyName f2 2023-02-18 10:01:18,694 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(310): Store=3c6c6b5cbdbb19e67171577c77eca03a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1a2f612a24cc43b17fcf44ac06b96e06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59271184, jitterRate=-0.1167905330657959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:18,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:18,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06., pid=23, masterSystemTime=1676714478666 2023-02-18 10:01:18,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:18,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:18,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:18,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d48ab80dab6d54367018d48a3afced9, NAME => 'testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 10:01:18,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3c6c6b5cbdbb19e67171577c77eca03a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69997763, jitterRate=0.0430479496717453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:18,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,706 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1a2f612a24cc43b17fcf44ac06b96e06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,707 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478706"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478706"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478706"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478706"}]},"ts":"1676714478706"} 2023-02-18 10:01:18,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a., pid=28, masterSystemTime=1676714478681 2023-02-18 10:01:18,708 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:18,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:18,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:18,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3c6c6b5cbdbb19e67171577c77eca03a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 10b51df27a03dead14dd2735ddaf817d, NAME => 'testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 10:01:18,709 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478709"}]},"ts":"1676714478709"} 2023-02-18 10:01:18,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,709 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1 2023-02-18 10:01:18,710 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1 2023-02-18 10:01:18,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,710 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d48ab80dab6d54367018d48a3afced9 columnFamilyName f1 2023-02-18 10:01:18,711 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(310): Store=0d48ab80dab6d54367018d48a3afced9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,711 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-18 10:01:18,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure 1a2f612a24cc43b17fcf44ac06b96e06, server=jenkins-hbase4.apache.org,45301,1676714476460 in 191 msec 2023-02-18 10:01:18,712 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,712 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2 2023-02-18 10:01:18,713 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2 2023-02-18 10:01:18,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1a2f612a24cc43b17fcf44ac06b96e06, ASSIGN in 359 msec 2023-02-18 10:01:18,713 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d48ab80dab6d54367018d48a3afced9 columnFamilyName f2 2023-02-18 10:01:18,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-18 10:01:18,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 3c6c6b5cbdbb19e67171577c77eca03a, server=jenkins-hbase4.apache.org,44613,1676714476499 in 177 msec 2023-02-18 10:01:18,713 DEBUG [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/f1 2023-02-18 10:01:18,714 DEBUG [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/f1 2023-02-18 10:01:18,714 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(310): Store=0d48ab80dab6d54367018d48a3afced9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,714 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10b51df27a03dead14dd2735ddaf817d columnFamilyName f1 2023-02-18 10:01:18,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c6c6b5cbdbb19e67171577c77eca03a, ASSIGN in 361 msec 2023-02-18 10:01:18,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,715 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(310): Store=10b51df27a03dead14dd2735ddaf817d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,715 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,716 DEBUG [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/f2 2023-02-18 10:01:18,716 DEBUG [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/f2 2023-02-18 10:01:18,716 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10b51df27a03dead14dd2735ddaf817d columnFamilyName f2 2023-02-18 10:01:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,717 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(310): Store=10b51df27a03dead14dd2735ddaf817d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:18,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d48ab80dab6d54367018d48a3afced9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74041280, jitterRate=0.1033010482788086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:18,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9., pid=24, masterSystemTime=1676714478666 2023-02-18 10:01:18,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:18,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:18,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:18,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:18,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5c81644f06fc3bea32af1c4819e61071, NAME => 'testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 10:01:18,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,724 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0d48ab80dab6d54367018d48a3afced9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478724"}]},"ts":"1676714478724"} 2023-02-18 10:01:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 10b51df27a03dead14dd2735ddaf817d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63416034, jitterRate=-0.05502745509147644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:18,726 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d., pid=27, masterSystemTime=1676714478681 2023-02-18 10:01:18,728 DEBUG [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/f1 2023-02-18 10:01:18,728 DEBUG [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/f1 2023-02-18 10:01:18,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:18,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:18,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-18 10:01:18,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:18,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=10b51df27a03dead14dd2735ddaf817d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure 0d48ab80dab6d54367018d48a3afced9, server=jenkins-hbase4.apache.org,45301,1676714476460 in 207 msec 2023-02-18 10:01:18,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => db63ae0323291aea1a5456851ff123a5, NAME => 'testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 10:01:18,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714478729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478729"}]},"ts":"1676714478729"} 2023-02-18 10:01:18,729 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c81644f06fc3bea32af1c4819e61071 columnFamilyName f1 2023-02-18 10:01:18,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,730 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(310): Store=5c81644f06fc3bea32af1c4819e61071/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,730 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0d48ab80dab6d54367018d48a3afced9, ASSIGN in 377 msec 2023-02-18 10:01:18,731 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,731 DEBUG [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/f2 2023-02-18 10:01:18,731 DEBUG [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/f2 2023-02-18 10:01:18,732 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c81644f06fc3bea32af1c4819e61071 columnFamilyName f2 2023-02-18 10:01:18,732 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1 2023-02-18 10:01:18,732 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1 2023-02-18 10:01:18,733 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(310): Store=5c81644f06fc3bea32af1c4819e61071/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-18 10:01:18,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 10b51df27a03dead14dd2735ddaf817d, server=jenkins-hbase4.apache.org,44613,1676714476499 in 199 msec 2023-02-18 10:01:18,733 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db63ae0323291aea1a5456851ff123a5 columnFamilyName f1 2023-02-18 10:01:18,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,734 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(310): Store=db63ae0323291aea1a5456851ff123a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,734 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=10b51df27a03dead14dd2735ddaf817d, ASSIGN in 381 msec 2023-02-18 10:01:18,735 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2 2023-02-18 10:01:18,735 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2 2023-02-18 10:01:18,736 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db63ae0323291aea1a5456851ff123a5 columnFamilyName f2 2023-02-18 10:01:18,736 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(310): Store=db63ae0323291aea1a5456851ff123a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:18,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5c81644f06fc3bea32af1c4819e61071; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68165074, jitterRate=0.015738755464553833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:18,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:18,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071., pid=21, masterSystemTime=1676714478666 2023-02-18 10:01:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:18,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:18,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6aaa0cc38e6f1bd43891541e91b24552, NAME => 'testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 10:01:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,744 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=5c81644f06fc3bea32af1c4819e61071, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,744 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676714478744"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478744"}]},"ts":"1676714478744"} 2023-02-18 10:01:18,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened db63ae0323291aea1a5456851ff123a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66117286, jitterRate=-0.014775663614273071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:18,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5., pid=30, masterSystemTime=1676714478681 2023-02-18 10:01:18,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:18,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:18,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:18,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e4618e0888ab5ba8745526cf8a075d6, NAME => 'testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 10:01:18,747 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=db63ae0323291aea1a5456851ff123a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478747"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478747"}]},"ts":"1676714478747"} 2023-02-18 10:01:18,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-18 10:01:18,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 5c81644f06fc3bea32af1c4819e61071, server=jenkins-hbase4.apache.org,45301,1676714476460 in 232 msec 2023-02-18 10:01:18,748 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5c81644f06fc3bea32af1c4819e61071, ASSIGN in 396 msec 2023-02-18 10:01:18,749 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,750 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1 2023-02-18 10:01:18,750 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1 2023-02-18 10:01:18,750 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aaa0cc38e6f1bd43891541e91b24552 columnFamilyName f1 2023-02-18 10:01:18,751 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(310): Store=6aaa0cc38e6f1bd43891541e91b24552/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-18 10:01:18,751 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure db63ae0323291aea1a5456851ff123a5, server=jenkins-hbase4.apache.org,44613,1676714476499 in 209 msec 2023-02-18 10:01:18,751 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1 2023-02-18 10:01:18,751 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1 2023-02-18 10:01:18,752 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4618e0888ab5ba8745526cf8a075d6 columnFamilyName f1 2023-02-18 10:01:18,752 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(310): Store=4e4618e0888ab5ba8745526cf8a075d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=db63ae0323291aea1a5456851ff123a5, ASSIGN in 399 msec 2023-02-18 10:01:18,753 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,753 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2 2023-02-18 10:01:18,754 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2 2023-02-18 10:01:18,754 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2 2023-02-18 10:01:18,754 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aaa0cc38e6f1bd43891541e91b24552 columnFamilyName f2 2023-02-18 10:01:18,754 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2 2023-02-18 10:01:18,754 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4618e0888ab5ba8745526cf8a075d6 columnFamilyName f2 2023-02-18 10:01:18,755 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(310): Store=6aaa0cc38e6f1bd43891541e91b24552/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,755 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(310): Store=4e4618e0888ab5ba8745526cf8a075d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:18,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e4618e0888ab5ba8745526cf8a075d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72083850, jitterRate=0.07413306832313538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:18,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6aaa0cc38e6f1bd43891541e91b24552; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63249065, jitterRate=-0.05751548707485199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:18,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6., pid=29, masterSystemTime=1676714478681 2023-02-18 10:01:18,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552., pid=22, masterSystemTime=1676714478666 2023-02-18 10:01:18,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:18,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:18,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 413dcc3a5721aac783af6ee6ba69f468, NAME => 'testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 10:01:18,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4e4618e0888ab5ba8745526cf8a075d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478768"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478768"}]},"ts":"1676714478768"} 2023-02-18 10:01:18,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6aaa0cc38e6f1bd43891541e91b24552, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,769 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478769"}]},"ts":"1676714478769"} 2023-02-18 10:01:18,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:18,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b3a018163b86c17a0f69d59a6b8c54e7, NAME => 'testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 10:01:18,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,770 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:18,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,772 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1 2023-02-18 10:01:18,772 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1 2023-02-18 10:01:18,773 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 413dcc3a5721aac783af6ee6ba69f468 columnFamilyName f1 2023-02-18 10:01:18,773 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(310): Store=413dcc3a5721aac783af6ee6ba69f468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-18 10:01:18,773 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure 4e4618e0888ab5ba8745526cf8a075d6, server=jenkins-hbase4.apache.org,44613,1676714476499 in 235 msec 2023-02-18 10:01:18,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-18 10:01:18,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 6aaa0cc38e6f1bd43891541e91b24552, server=jenkins-hbase4.apache.org,45301,1676714476460 in 256 msec 2023-02-18 10:01:18,775 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e4618e0888ab5ba8745526cf8a075d6, ASSIGN in 422 msec 2023-02-18 10:01:18,775 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2 2023-02-18 10:01:18,776 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2 2023-02-18 10:01:18,776 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 413dcc3a5721aac783af6ee6ba69f468 columnFamilyName f2 2023-02-18 10:01:18,776 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1 2023-02-18 10:01:18,776 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1 2023-02-18 10:01:18,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6aaa0cc38e6f1bd43891541e91b24552, ASSIGN in 422 msec 2023-02-18 10:01:18,776 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3a018163b86c17a0f69d59a6b8c54e7 columnFamilyName f1 2023-02-18 10:01:18,777 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(310): Store=413dcc3a5721aac783af6ee6ba69f468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,777 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(310): Store=b3a018163b86c17a0f69d59a6b8c54e7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,777 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,778 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2 2023-02-18 10:01:18,778 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2 2023-02-18 10:01:18,779 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3a018163b86c17a0f69d59a6b8c54e7 columnFamilyName f2 2023-02-18 10:01:18,779 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(310): Store=b3a018163b86c17a0f69d59a6b8c54e7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:18,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:18,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:18,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:18,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 413dcc3a5721aac783af6ee6ba69f468; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74089247, jitterRate=0.10401581227779388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:18,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b3a018163b86c17a0f69d59a6b8c54e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75024698, jitterRate=0.11795511841773987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:18,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:18,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468., pid=26, masterSystemTime=1676714478681 2023-02-18 10:01:18,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7., pid=25, masterSystemTime=1676714478666 2023-02-18 10:01:18,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:18,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:18,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b3a018163b86c17a0f69d59a6b8c54e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:18,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478792"}]},"ts":"1676714478792"} 2023-02-18 10:01:18,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:18,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:18,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=413dcc3a5721aac783af6ee6ba69f468, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:18,793 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676714478793"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714478793"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714478793"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714478793"}]},"ts":"1676714478793"} 2023-02-18 10:01:18,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-18 10:01:18,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure b3a018163b86c17a0f69d59a6b8c54e7, server=jenkins-hbase4.apache.org,45301,1676714476460 in 273 msec 2023-02-18 10:01:18,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-18 10:01:18,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure 413dcc3a5721aac783af6ee6ba69f468, server=jenkins-hbase4.apache.org,44613,1676714476499 in 268 msec 2023-02-18 10:01:18,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b3a018163b86c17a0f69d59a6b8c54e7, ASSIGN in 444 msec 2023-02-18 10:01:18,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-18 10:01:18,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=413dcc3a5721aac783af6ee6ba69f468, ASSIGN in 445 msec 2023-02-18 10:01:18,802 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:18,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714478802"}]},"ts":"1676714478802"} 2023-02-18 10:01:18,803 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 10:01:18,879 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:18,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0250 sec 2023-02-18 10:01:18,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:18,971 INFO [Listener at localhost/40099] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 10:01:18,971 DEBUG [Listener at localhost/40099] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 10:01:18,971 INFO [Listener at localhost/40099] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:18,976 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 10:01:18,976 INFO [Listener at localhost/40099] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:18,976 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 10:01:18,976 INFO [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:19,051 DEBUG [hconnection-0x4d3db339-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:19,077 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:19,096 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45301] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:19,103 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44613] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:19,199 INFO [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:19,200 INFO [Listener at localhost/40099] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:19,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:19,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714479201 (current time:1676714479201). 2023-02-18 10:01:19,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:19,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] zookeeper.ReadOnlyZKClient(139): Connect 0x5f7f555c to 127.0.0.1:58440 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:19,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69e8138d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:19,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:19,305 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58378, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:19,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f7f555c to 127.0.0.1:58440 2023-02-18 10:01:19,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:19,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:19,310 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:19,310 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676715079310 2023-02-18 10:01:19,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:19,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 10:01:19,311 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:19,312 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:19,312 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:19,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:19,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-18 10:01:19,313 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:19,314 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676715079314 2023-02-18 10:01:19,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,323 INFO [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-18 10:01:19,323 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:19,323 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-18 10:01:19,323 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-18 10:01:19,412 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:19,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:19,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:19,414 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:19,415 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 10:01:19,431 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,431 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,614 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:19,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:19,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:19,616 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 10:01:19,654 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,655 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:19,655 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:19,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:19,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:19,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:19,655 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,655 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,656 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,656 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 10:01:19,657 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-18 10:01:19,658 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:19,659 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-18 10:01:19,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,659 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-18 10:01:19,659 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44613,1676714476499' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-18 10:01:19,659 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-18 10:01:19,659 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-18 10:01:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-18 10:01:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45301,1676714476460' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-18 10:01:19,770 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,770 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:19,863 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,864 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44613,1676714476499' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-18 10:01:19,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e36193a[Count = 1] remaining members to acquire global barrier 2023-02-18 10:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:19,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45301,1676714476460' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-18 10:01:19,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e36193a[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:19,868 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-18 10:01:19,868 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,917 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:19,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:19,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:19,919 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 10:01:19,946 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,946 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:19,947 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:19,947 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:19,947 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:19,947 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:19,947 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:19,948 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:19,948 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:19,947 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. started... 2023-02-18 10:01:19,948 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 10:01:19,948 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:19,947 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:19,948 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:19,949 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:19,948 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:19,948 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. started... 2023-02-18 10:01:19,949 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. started... 2023-02-18 10:01:19,949 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. started... 2023-02-18 10:01:19,950 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3c6c6b5cbdbb19e67171577c77eca03a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:19,949 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. started... 2023-02-18 10:01:19,949 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6aaa0cc38e6f1bd43891541e91b24552 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:19,948 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. started... 2023-02-18 10:01:19,948 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 10:01:19,952 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:19,952 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4e4618e0888ab5ba8745526cf8a075d6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:19,952 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0d48ab80dab6d54367018d48a3afced9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:19,951 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegion(2744): Flushing db63ae0323291aea1a5456851ff123a5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:19,950 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HRegion(2744): Flushing b3a018163b86c17a0f69d59a6b8c54e7 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 10:01:19,997 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f1/c96a8d6ed8124172b30f9147148c294c 2023-02-18 10:01:20,009 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f1/c92fd5a443d44b64a36286fd2db293c8 2023-02-18 10:01:20,028 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f1/697ce59d278e4ea9af2beffdd6590fa1 2023-02-18 10:01:20,028 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f1/5a2f1ee3a64e45758319a3cd0cf27b78 2023-02-18 10:01:20,050 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f2/a46f6b126062485c80502e6ef5bcf73b 2023-02-18 10:01:20,056 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f1/c96a8d6ed8124172b30f9147148c294c as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/c96a8d6ed8124172b30f9147148c294c 2023-02-18 10:01:20,061 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/c96a8d6ed8124172b30f9147148c294c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,062 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f2/a46f6b126062485c80502e6ef5bcf73b as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/a46f6b126062485c80502e6ef5bcf73b 2023-02-18 10:01:20,064 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f1/96ac118cf8bb4d35af529c86c3e1384c 2023-02-18 10:01:20,069 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/a46f6b126062485c80502e6ef5bcf73b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,073 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for db63ae0323291aea1a5456851ff123a5 in 123ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,073 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 10:01:20,074 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:20,074 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,075 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,075 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/c96a8d6ed8124172b30f9147148c294c] hfiles 2023-02-18 10:01:20,075 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/c96a8d6ed8124172b30f9147148c294c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,075 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/a46f6b126062485c80502e6ef5bcf73b] hfiles 2023-02-18 10:01:20,075 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/a46f6b126062485c80502e6ef5bcf73b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,082 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f2/f4e4556470ba4da7a0709ce493c179e6 2023-02-18 10:01:20,088 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f1/c92fd5a443d44b64a36286fd2db293c8 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/c92fd5a443d44b64a36286fd2db293c8 2023-02-18 10:01:20,094 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/c92fd5a443d44b64a36286fd2db293c8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,095 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f2/f4e4556470ba4da7a0709ce493c179e6 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/f4e4556470ba4da7a0709ce493c179e6 2023-02-18 10:01:20,104 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f2/4c394c0b3c1248b9b314f5ce14faaf8a 2023-02-18 10:01:20,109 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/f4e4556470ba4da7a0709ce493c179e6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,110 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6aaa0cc38e6f1bd43891541e91b24552 in 161ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,111 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f1/5a2f1ee3a64e45758319a3cd0cf27b78 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/5a2f1ee3a64e45758319a3cd0cf27b78 2023-02-18 10:01:20,113 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:20,113 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,113 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,113 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/c92fd5a443d44b64a36286fd2db293c8] hfiles 2023-02-18 10:01:20,113 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f2/827998ef33224601a3dd92d31e122600 2023-02-18 10:01:20,113 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/c92fd5a443d44b64a36286fd2db293c8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,114 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/f4e4556470ba4da7a0709ce493c179e6] hfiles 2023-02-18 10:01:20,114 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/f4e4556470ba4da7a0709ce493c179e6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,120 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f2/5f4e33feb8ed4eeabf651fcc3ca1ce3e 2023-02-18 10:01:20,123 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. completed. 2023-02-18 10:01:20,124 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:20,124 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:20,124 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 10:01:20,124 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. started... 2023-02-18 10:01:20,126 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f1/96ac118cf8bb4d35af529c86c3e1384c as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/96ac118cf8bb4d35af529c86c3e1384c 2023-02-18 10:01:20,126 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/5a2f1ee3a64e45758319a3cd0cf27b78, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,129 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 413dcc3a5721aac783af6ee6ba69f468 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 10:01:20,129 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f2/4c394c0b3c1248b9b314f5ce14faaf8a as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/4c394c0b3c1248b9b314f5ce14faaf8a 2023-02-18 10:01:20,134 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/96ac118cf8bb4d35af529c86c3e1384c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,135 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f2/5f4e33feb8ed4eeabf651fcc3ca1ce3e as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/5f4e33feb8ed4eeabf651fcc3ca1ce3e 2023-02-18 10:01:20,137 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/4c394c0b3c1248b9b314f5ce14faaf8a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,137 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. completed. 2023-02-18 10:01:20,137 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:20,137 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:20,137 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. started... 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,138 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0d48ab80dab6d54367018d48a3afced9 in 186ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,138 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/5a2f1ee3a64e45758319a3cd0cf27b78] hfiles 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/5a2f1ee3a64e45758319a3cd0cf27b78 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/4c394c0b3c1248b9b314f5ce14faaf8a] hfiles 2023-02-18 10:01:20,138 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/4c394c0b3c1248b9b314f5ce14faaf8a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,149 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f1/697ce59d278e4ea9af2beffdd6590fa1 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/697ce59d278e4ea9af2beffdd6590fa1 2023-02-18 10:01:20,154 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/697ce59d278e4ea9af2beffdd6590fa1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:20,155 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f2/827998ef33224601a3dd92d31e122600 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/827998ef33224601a3dd92d31e122600 2023-02-18 10:01:20,158 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/5f4e33feb8ed4eeabf651fcc3ca1ce3e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,160 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4e4618e0888ab5ba8745526cf8a075d6 in 208ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/96ac118cf8bb4d35af529c86c3e1384c] hfiles 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/96ac118cf8bb4d35af529c86c3e1384c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/5f4e33feb8ed4eeabf651fcc3ca1ce3e] hfiles 2023-02-18 10:01:20,160 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/5f4e33feb8ed4eeabf651fcc3ca1ce3e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,161 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. completed. 2023-02-18 10:01:20,161 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:20,161 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:20,161 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. started... 2023-02-18 10:01:20,161 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1a2f612a24cc43b17fcf44ac06b96e06 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:20,161 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 10:01:20,165 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/827998ef33224601a3dd92d31e122600, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:20,165 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b3a018163b86c17a0f69d59a6b8c54e7 in 215ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,165 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. completed. 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/697ce59d278e4ea9af2beffdd6590fa1] hfiles 2023-02-18 10:01:20,166 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/697ce59d278e4ea9af2beffdd6590fa1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/827998ef33224601a3dd92d31e122600] hfiles 2023-02-18 10:01:20,166 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/827998ef33224601a3dd92d31e122600 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. completed. 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:20,180 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. started... 2023-02-18 10:01:20,180 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f1/d8f22dc31b0a48d0b0119acb6aa03373 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,180 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:20,181 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:20,182 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. completed. 2023-02-18 10:01:20,182 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:20,182 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 10:01:20,194 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. completed. 2023-02-18 10:01:20,194 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:20,194 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 10:01:20,203 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f2/5bea973b409a456895b140c557f2a3cf 2023-02-18 10:01:20,209 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f1/d8f22dc31b0a48d0b0119acb6aa03373 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/d8f22dc31b0a48d0b0119acb6aa03373 2023-02-18 10:01:20,214 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/d8f22dc31b0a48d0b0119acb6aa03373, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,214 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f2/5bea973b409a456895b140c557f2a3cf as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/5bea973b409a456895b140c557f2a3cf 2023-02-18 10:01:20,219 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/5bea973b409a456895b140c557f2a3cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,220 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1a2f612a24cc43b17fcf44ac06b96e06 in 58ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/d8f22dc31b0a48d0b0119acb6aa03373] hfiles 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/d8f22dc31b0a48d0b0119acb6aa03373 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/5bea973b409a456895b140c557f2a3cf] hfiles 2023-02-18 10:01:20,220 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/5bea973b409a456895b140c557f2a3cf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,229 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. completed. 2023-02-18 10:01:20,229 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 10:01:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 10:01:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-18 10:01:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,45301,1676714476460' in zk 2023-02-18 10:01:20,300 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-18 10:01:20,300 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,300 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:20,300 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-18 10:01:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,45301,1676714476460': 2023-02-18 10:01:20,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45301,1676714476460' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 10:01:20,419 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:20,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:20,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:20,420 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-18 10:01:20,436 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f1/86d096981f214fe78a24f675f97ce1fb 2023-02-18 10:01:20,451 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f2/7fc4e90994af445394c4b540fa7d78a9 2023-02-18 10:01:20,457 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f1/86d096981f214fe78a24f675f97ce1fb as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/86d096981f214fe78a24f675f97ce1fb 2023-02-18 10:01:20,462 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/86d096981f214fe78a24f675f97ce1fb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,463 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f2/7fc4e90994af445394c4b540fa7d78a9 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/7fc4e90994af445394c4b540fa7d78a9 2023-02-18 10:01:20,467 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/7fc4e90994af445394c4b540fa7d78a9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:20,467 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3c6c6b5cbdbb19e67171577c77eca03a in 517ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/86d096981f214fe78a24f675f97ce1fb] hfiles 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/86d096981f214fe78a24f675f97ce1fb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/7fc4e90994af445394c4b540fa7d78a9] hfiles 2023-02-18 10:01:20,468 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/7fc4e90994af445394c4b540fa7d78a9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,474 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. completed. 2023-02-18 10:01:20,474 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:20,474 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 10:01:20,562 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f1/479dddd52c7940e4bc760cca543f5db5 2023-02-18 10:01:20,575 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f2/d382b4b855a2429bb321ed014a75e1d3 2023-02-18 10:01:20,581 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f1/479dddd52c7940e4bc760cca543f5db5 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/479dddd52c7940e4bc760cca543f5db5 2023-02-18 10:01:20,585 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/479dddd52c7940e4bc760cca543f5db5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:20,586 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f2/d382b4b855a2429bb321ed014a75e1d3 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/d382b4b855a2429bb321ed014a75e1d3 2023-02-18 10:01:20,590 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/d382b4b855a2429bb321ed014a75e1d3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:20,591 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 413dcc3a5721aac783af6ee6ba69f468 in 462ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:20,591 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:20,591 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/479dddd52c7940e4bc760cca543f5db5] hfiles 2023-02-18 10:01:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/479dddd52c7940e4bc760cca543f5db5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/d382b4b855a2429bb321ed014a75e1d3] hfiles 2023-02-18 10:01:20,592 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/d382b4b855a2429bb321ed014a75e1d3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,598 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. completed. 2023-02-18 10:01:20,598 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 10:01:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 10:01:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-18 10:01:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,44613,1676714476499' in zk 2023-02-18 10:01:20,650 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-18 10:01:20,650 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,650 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:20,650 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-18 10:01:20,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:20,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:20,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,44613,1676714476499': 2023-02-18 10:01:20,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44613,1676714476499' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:20,654 INFO [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-18 10:01:20,654 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:20,654 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:20,654 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,654 INFO [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:20,693 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:20,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:20,693 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:20,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:20,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:20,693 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:20,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,694 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:20,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,695 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,696 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:20,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:20,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:20,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:20,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,015 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:21,015 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:21,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:21,015 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:21,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:21,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion because node does not exist (not an error) 2023-02-18 10:01:21,015 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:21,015 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:21,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,015 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:21,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:21,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:21,016 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,017 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-18 10:01:21,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,096 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:21,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676714479310Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676714481015 (+1705 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676714481017 (+2 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676714481033 (+16 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676714481044 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676714481095 (+51 ms) 2023-02-18 10:01:21,098 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:21,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.7870 sec 2023-02-18 10:01:21,421 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:21,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:21,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:21,423 INFO [Listener at localhost/40099] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:21,427 INFO [Listener at localhost/40099] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:21,435 INFO [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:21,494 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45301] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:21,496 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44613] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:21,600 INFO [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:21,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:21,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 10:01:21,616 INFO [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 10:01:21,617 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:21,620 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 10:01:21,620 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 10:01:21,621 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:21,621 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:21,700 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:21,700 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:21,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:21,700 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:21,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:21,701 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:21,701 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:21,702 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,702 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 10:01:21,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 10:01:21,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 10:01:21,703 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 10:01:21,703 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:21,704 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 10:01:21,704 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 10:01:21,704 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. started... 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 10:01:21,705 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6aaa0cc38e6f1bd43891541e91b24552 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. started... 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. started... 2023-02-18 10:01:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. started... 2023-02-18 10:01:21,705 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. started... 2023-02-18 10:01:21,706 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3c6c6b5cbdbb19e67171577c77eca03a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:21,706 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0d48ab80dab6d54367018d48a3afced9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:21,706 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing db63ae0323291aea1a5456851ff123a5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:21,706 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b3a018163b86c17a0f69d59a6b8c54e7 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 10:01:21,706 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. started... 2023-02-18 10:01:21,707 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e4618e0888ab5ba8745526cf8a075d6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:21,752 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f1/2dc31532f78b489ea518ea938082d227 2023-02-18 10:01:21,761 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f1/0d04771645da451a9678d64cadd6998f 2023-02-18 10:01:21,765 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f1/240499e4c0a34e9d8d8bfb6ded998cbd 2023-02-18 10:01:21,793 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f2/5fed3937ecd341e5b3c15c0e88efddd5 2023-02-18 10:01:21,794 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f1/065e43be12504e35868a14fe29a57dd8 2023-02-18 10:01:21,797 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f1/2988923f39ac41c284836fd164562be1 2023-02-18 10:01:21,805 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f1/2dc31532f78b489ea518ea938082d227 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/2dc31532f78b489ea518ea938082d227 2023-02-18 10:01:21,821 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/2dc31532f78b489ea518ea938082d227, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,822 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/.tmp/f2/5fed3937ecd341e5b3c15c0e88efddd5 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/5fed3937ecd341e5b3c15c0e88efddd5 2023-02-18 10:01:21,837 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/5fed3937ecd341e5b3c15c0e88efddd5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,838 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3c6c6b5cbdbb19e67171577c77eca03a in 132ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,838 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:21,838 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:21,847 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:21,847 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 10:01:21,847 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. started... 2023-02-18 10:01:21,847 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 413dcc3a5721aac783af6ee6ba69f468 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 10:01:21,855 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f2/a49ff8b0aa0c49e99211d46c356d84cc 2023-02-18 10:01:21,860 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f2/e538283ddd3c41f9a3709747cc486c08 2023-02-18 10:01:21,868 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f1/0d04771645da451a9678d64cadd6998f as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/0d04771645da451a9678d64cadd6998f 2023-02-18 10:01:21,871 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f1/240499e4c0a34e9d8d8bfb6ded998cbd as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/240499e4c0a34e9d8d8bfb6ded998cbd 2023-02-18 10:01:21,875 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f2/5434970873624f4a9a7dd714d1a9d3a7 2023-02-18 10:01:21,876 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/0d04771645da451a9678d64cadd6998f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,877 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f2/cab92b52038a4ff1ba791ff3645d8095 2023-02-18 10:01:21,878 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/240499e4c0a34e9d8d8bfb6ded998cbd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,879 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/.tmp/f2/a49ff8b0aa0c49e99211d46c356d84cc as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/a49ff8b0aa0c49e99211d46c356d84cc 2023-02-18 10:01:21,880 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/.tmp/f2/e538283ddd3c41f9a3709747cc486c08 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/e538283ddd3c41f9a3709747cc486c08 2023-02-18 10:01:21,884 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f1/0e48993b2cb54adda797a30fb6448272 2023-02-18 10:01:21,887 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f1/065e43be12504e35868a14fe29a57dd8 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/065e43be12504e35868a14fe29a57dd8 2023-02-18 10:01:21,888 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/a49ff8b0aa0c49e99211d46c356d84cc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,888 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/e538283ddd3c41f9a3709747cc486c08, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,889 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4e4618e0888ab5ba8745526cf8a075d6 in 183ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,889 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for db63ae0323291aea1a5456851ff123a5 in 183ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:21,889 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. started... 2023-02-18 10:01:21,889 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 10:01:21,889 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:21,890 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 10:01:21,892 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f1/2988923f39ac41c284836fd164562be1 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/2988923f39ac41c284836fd164562be1 2023-02-18 10:01:21,894 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/065e43be12504e35868a14fe29a57dd8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,897 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/2988923f39ac41c284836fd164562be1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,898 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/.tmp/f2/5434970873624f4a9a7dd714d1a9d3a7 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/5434970873624f4a9a7dd714d1a9d3a7 2023-02-18 10:01:21,899 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/.tmp/f2/cab92b52038a4ff1ba791ff3645d8095 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/cab92b52038a4ff1ba791ff3645d8095 2023-02-18 10:01:21,909 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/cab92b52038a4ff1ba791ff3645d8095, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,910 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/5434970873624f4a9a7dd714d1a9d3a7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,911 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0d48ab80dab6d54367018d48a3afced9 in 205ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,911 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:21,911 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:21,912 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6aaa0cc38e6f1bd43891541e91b24552 in 207ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. started... 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. started... 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:21,912 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:21,912 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1a2f612a24cc43b17fcf44ac06b96e06 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:21,915 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 10:01:21,915 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 10:01:21,915 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 10:01:21,920 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f2/389c598195fd4f70ba610555acb14f71 2023-02-18 10:01:21,928 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f1/0e48993b2cb54adda797a30fb6448272 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/0e48993b2cb54adda797a30fb6448272 2023-02-18 10:01:21,933 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/0e48993b2cb54adda797a30fb6448272, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:21,934 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/.tmp/f2/389c598195fd4f70ba610555acb14f71 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/389c598195fd4f70ba610555acb14f71 2023-02-18 10:01:21,937 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f1/c8724632ff1641e485f05ba2d197db16 2023-02-18 10:01:21,941 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/389c598195fd4f70ba610555acb14f71, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:21,942 INFO [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 413dcc3a5721aac783af6ee6ba69f468 in 95ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,942 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:21,942 DEBUG [rs(jenkins-hbase4.apache.org,44613,1676714476499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:21,943 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 10:01:21,943 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 10:01:21,943 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,943 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 10:01:21,943 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44613,1676714476499' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 10:01:21,962 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f2/99ba34e365244c46a132a8167dd2c596 2023-02-18 10:01:21,968 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f1/c8724632ff1641e485f05ba2d197db16 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/c8724632ff1641e485f05ba2d197db16 2023-02-18 10:01:21,975 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/c8724632ff1641e485f05ba2d197db16, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,976 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/.tmp/f2/99ba34e365244c46a132a8167dd2c596 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/99ba34e365244c46a132a8167dd2c596 2023-02-18 10:01:21,985 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,985 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/99ba34e365244c46a132a8167dd2c596, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:21,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:21,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:21,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44613,1676714476499' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 10:01:21,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a099c24[Count = 1] remaining members to acquire global barrier 2023-02-18 10:01:21,988 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1a2f612a24cc43b17fcf44ac06b96e06 in 76ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:21,989 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:21,989 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:21,989 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 10:01:22,201 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f1/f957b1c9208043f8a6fffdc7a97387c5 2023-02-18 10:01:22,217 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f2/529d025441a14a92987d272a70a6499e 2023-02-18 10:01:22,223 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f1/f957b1c9208043f8a6fffdc7a97387c5 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/f957b1c9208043f8a6fffdc7a97387c5 2023-02-18 10:01:22,228 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/f957b1c9208043f8a6fffdc7a97387c5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:22,229 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/.tmp/f2/529d025441a14a92987d272a70a6499e as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/529d025441a14a92987d272a70a6499e 2023-02-18 10:01:22,234 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/529d025441a14a92987d272a70a6499e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:22,235 INFO [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b3a018163b86c17a0f69d59a6b8c54e7 in 529ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:22,235 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:22,235 DEBUG [rs(jenkins-hbase4.apache.org,45301,1676714476460)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:22,235 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 10:01:22,235 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 10:01:22,235 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,235 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 10:01:22,235 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45301,1676714476460' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 10:01:22,239 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,239 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:22,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:22,239 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,239 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:22,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:22,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:22,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:22,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45301,1676714476460' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 10:01:22,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a099c24[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:22,241 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 10:01:22,241 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,242 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,242 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 10:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 10:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 10:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 10:01:22,243 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44613,1676714476499' in zk 2023-02-18 10:01:22,243 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45301,1676714476460' in zk 2023-02-18 10:01:22,243 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,244 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:22,245 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,245 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 10:01:22,245 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 10:01:22,245 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:22,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:22,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:22,245 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,245 DEBUG [member: 'jenkins-hbase4.apache.org,45301,1676714476460' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 10:01:22,245 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:22,246 DEBUG [member: 'jenkins-hbase4.apache.org,44613,1676714476499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 10:01:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45301,1676714476460': 2023-02-18 10:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45301,1676714476460' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-18 10:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44613,1676714476499': 2023-02-18 10:01:22,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44613,1676714476499' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 10:01:22,255 INFO [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 10:01:22,255 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:22,255 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:22,255 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 10:01:22,255 INFO [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:22,257 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:22,257 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:22,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,257 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:22,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:22,258 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,259 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:22,262 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:22,262 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,267 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,267 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:22,267 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:22,267 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:22,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:22,268 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:22,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:22,268 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:22,268 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,268 DEBUG [(jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:22,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 10:01:22,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:22,268 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:22,269 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,269 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,269 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,269 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:22,269 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:22,269 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:22,270 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:22,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:22,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:22,370 DEBUG [Listener at localhost/40099] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:22,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43321] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:22,371 INFO [Listener at localhost/40099] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:22,372 DEBUG [Listener at localhost/40099] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08ba379c to 127.0.0.1:58440 2023-02-18 10:01:22,372 DEBUG [Listener at localhost/40099] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,372 DEBUG [Listener at localhost/40099] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:22,372 DEBUG [Listener at localhost/40099] util.JVMClusterUtil(257): Found active master hash=672228511, stopped=false 2023-02-18 10:01:22,372 INFO [Listener at localhost/40099] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:22,374 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:22,374 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:22,374 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:22,374 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:22,374 INFO [Listener at localhost/40099] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:22,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:22,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:22,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:22,376 DEBUG [Listener at localhost/40099] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5823e739 to 127.0.0.1:58440 2023-02-18 10:01:22,377 DEBUG [Listener at localhost/40099] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,377 INFO [Listener at localhost/40099] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45301,1676714476460' ***** 2023-02-18 10:01:22,377 INFO [Listener at localhost/40099] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:22,377 INFO [Listener at localhost/40099] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44613,1676714476499' ***** 2023-02-18 10:01:22,377 INFO [Listener at localhost/40099] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:22,377 INFO [RS:0;jenkins-hbase4:45301] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:22,377 INFO [RS:1;jenkins-hbase4:44613] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:22,377 INFO [RS:1;jenkins-hbase4:44613] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:22,377 INFO [RS:0;jenkins-hbase4:45301] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:22,377 INFO [RS:0;jenkins-hbase4:45301] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:22,377 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(3304): Received CLOSE for 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:22,377 INFO [RS:1;jenkins-hbase4:44613] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:22,377 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:22,377 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:22,379 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:22,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6aaa0cc38e6f1bd43891541e91b24552, disabling compactions & flushes 2023-02-18 10:01:22,379 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(3304): Received CLOSE for b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:22,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:22,379 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(3304): Received CLOSE for 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:22,379 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:22,379 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(3304): Received CLOSE for 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:22,380 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for d77c02c173785f38c9817e40046d2213 2023-02-18 10:01:22,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:22,380 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:22,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e4618e0888ab5ba8745526cf8a075d6, disabling compactions & flushes 2023-02-18 10:01:22,380 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:22,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. after waiting 0 ms 2023-02-18 10:01:22,380 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(3304): Received CLOSE for 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:22,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:22,380 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:22,380 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:22,380 DEBUG [RS:1;jenkins-hbase4:44613] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dd6f68f to 127.0.0.1:58440 2023-02-18 10:01:22,380 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,380 DEBUG [RS:0;jenkins-hbase4:45301] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6537bbbe to 127.0.0.1:58440 2023-02-18 10:01:22,381 DEBUG [RS:0;jenkins-hbase4:45301] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,381 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-18 10:01:22,381 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1479): Online Regions={6aaa0cc38e6f1bd43891541e91b24552=testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552., b3a018163b86c17a0f69d59a6b8c54e7=testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7., 0d48ab80dab6d54367018d48a3afced9=testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9., 5c81644f06fc3bea32af1c4819e61071=testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071., 1a2f612a24cc43b17fcf44ac06b96e06=testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.} 2023-02-18 10:01:22,381 DEBUG [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1505): Waiting on 0d48ab80dab6d54367018d48a3afced9, 1a2f612a24cc43b17fcf44ac06b96e06, 5c81644f06fc3bea32af1c4819e61071, 6aaa0cc38e6f1bd43891541e91b24552, b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:22,380 DEBUG [RS:1;jenkins-hbase4:44613] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:22,383 INFO [RS:1;jenkins-hbase4:44613] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:22,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. after waiting 0 ms 2023-02-18 10:01:22,384 INFO [RS:1;jenkins-hbase4:44613] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:22,384 INFO [RS:1;jenkins-hbase4:44613] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:22,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:22,384 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:22,385 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-18 10:01:22,386 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1479): Online Regions={4e4618e0888ab5ba8745526cf8a075d6=testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6., 3c6c6b5cbdbb19e67171577c77eca03a=testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a., d77c02c173785f38c9817e40046d2213=hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213., 1588230740=hbase:meta,,1.1588230740, db63ae0323291aea1a5456851ff123a5=testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5., 413dcc3a5721aac783af6ee6ba69f468=testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468., 10b51df27a03dead14dd2735ddaf817d=testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.} 2023-02-18 10:01:22,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:22,387 DEBUG [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1505): Waiting on 10b51df27a03dead14dd2735ddaf817d, 1588230740, 3c6c6b5cbdbb19e67171577c77eca03a, 413dcc3a5721aac783af6ee6ba69f468, 4e4618e0888ab5ba8745526cf8a075d6, d77c02c173785f38c9817e40046d2213, db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:22,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:22,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:22,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:22,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:22,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-18 10:01:22,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:22,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:22,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:22,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3c6c6b5cbdbb19e67171577c77eca03a, disabling compactions & flushes 2023-02-18 10:01:22,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:22,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:22,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. after waiting 0 ms 2023-02-18 10:01:22,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:22,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:22,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b3a018163b86c17a0f69d59a6b8c54e7, disabling compactions & flushes 2023-02-18 10:01:22,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. after waiting 0 ms 2023-02-18 10:01:22,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:22,420 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:22,420 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:22,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/.tmp/info/6c45f04524b24e23829e8262d8dabf4f 2023-02-18 10:01:22,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:22,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:22,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:22,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d48ab80dab6d54367018d48a3afced9, disabling compactions & flushes 2023-02-18 10:01:22,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:22,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:22,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. after waiting 0 ms 2023-02-18 10:01:22,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:22,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:22,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:22,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:22,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d77c02c173785f38c9817e40046d2213, disabling compactions & flushes 2023-02-18 10:01:22,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:22,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:22,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. after waiting 0 ms 2023-02-18 10:01:22,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:22,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d77c02c173785f38c9817e40046d2213 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:22,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:22,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:22,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:22,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5c81644f06fc3bea32af1c4819e61071, disabling compactions & flushes 2023-02-18 10:01:22,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:22,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:22,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. after waiting 0 ms 2023-02-18 10:01:22,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:22,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/.tmp/table/8de7e506c8b24417b62639331856c3c9 2023-02-18 10:01:22,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/.tmp/info/6c45f04524b24e23829e8262d8dabf4f as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/info/6c45f04524b24e23829e8262d8dabf4f 2023-02-18 10:01:22,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/.tmp/info/86b742967e5d49d1b4d8024ea484e795 2023-02-18 10:01:22,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 10:01:22,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:22,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:22,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:22,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1a2f612a24cc43b17fcf44ac06b96e06, disabling compactions & flushes 2023-02-18 10:01:22,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:22,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:22,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. after waiting 0 ms 2023-02-18 10:01:22,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:22,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/info/6c45f04524b24e23829e8262d8dabf4f, entries=110, sequenceid=32, filesize=18.7 K 2023-02-18 10:01:22,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/.tmp/info/86b742967e5d49d1b4d8024ea484e795 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/info/86b742967e5d49d1b4d8024ea484e795 2023-02-18 10:01:22,455 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/.tmp/table/8de7e506c8b24417b62639331856c3c9 as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/table/8de7e506c8b24417b62639331856c3c9 2023-02-18 10:01:22,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:22,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:22,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:22,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/info/86b742967e5d49d1b4d8024ea484e795, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:22,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/table/8de7e506c8b24417b62639331856c3c9, entries=4, sequenceid=32, filesize=4.8 K 2023-02-18 10:01:22,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d77c02c173785f38c9817e40046d2213 in 34ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:22,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 10:01:22,464 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=32, compaction requested=false 2023-02-18 10:01:22,464 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 10:01:22,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/namespace/d77c02c173785f38c9817e40046d2213/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:22,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:22,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d77c02c173785f38c9817e40046d2213: 2023-02-18 10:01:22,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714477141.d77c02c173785f38c9817e40046d2213. 2023-02-18 10:01:22,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing db63ae0323291aea1a5456851ff123a5, disabling compactions & flushes 2023-02-18 10:01:22,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:22,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:22,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. after waiting 0 ms 2023-02-18 10:01:22,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:22,474 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-18 10:01:22,475 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:22,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:22,475 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:22,475 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:22,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:22,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:22,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:22,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 413dcc3a5721aac783af6ee6ba69f468, disabling compactions & flushes 2023-02-18 10:01:22,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:22,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:22,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. after waiting 0 ms 2023-02-18 10:01:22,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:22,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:22,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:22,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:22,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:22,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 10b51df27a03dead14dd2735ddaf817d, disabling compactions & flushes 2023-02-18 10:01:22,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:22,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:22,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. after waiting 0 ms 2023-02-18 10:01:22,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:22,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 10:01:22,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:22,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:22,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:22,583 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45301,1676714476460; all regions closed. 2023-02-18 10:01:22,587 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44613,1676714476499; all regions closed. 2023-02-18 10:01:22,589 DEBUG [RS:0;jenkins-hbase4:45301] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/oldWALs 2023-02-18 10:01:22,589 INFO [RS:0;jenkins-hbase4:45301] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45301%2C1676714476460:(num 1676714477830) 2023-02-18 10:01:22,590 DEBUG [RS:0;jenkins-hbase4:45301] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,590 INFO [RS:0;jenkins-hbase4:45301] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:22,590 INFO [RS:0;jenkins-hbase4:45301] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:22,590 INFO [RS:0;jenkins-hbase4:45301] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:22,590 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:22,590 INFO [RS:0;jenkins-hbase4:45301] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:22,590 INFO [RS:0;jenkins-hbase4:45301] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:22,591 INFO [RS:0;jenkins-hbase4:45301] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45301 2023-02-18 10:01:22,596 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:22,596 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,596 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45301,1676714476460 2023-02-18 10:01:22,596 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:22,596 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@24915548 rejected from java.util.concurrent.ThreadPoolExecutor@20aed502[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:22,596 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:22,596 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a16d89a rejected from java.util.concurrent.ThreadPoolExecutor@20aed502[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:22,596 DEBUG [RS:1;jenkins-hbase4:44613] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/oldWALs 2023-02-18 10:01:22,596 INFO [RS:1;jenkins-hbase4:44613] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44613%2C1676714476499.meta:.meta(num 1676714477082) 2023-02-18 10:01:22,597 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45301,1676714476460] 2023-02-18 10:01:22,597 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45301,1676714476460; numProcessing=1 2023-02-18 10:01:22,599 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45301,1676714476460 already deleted, retry=false 2023-02-18 10:01:22,599 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45301,1676714476460 expired; onlineServers=1 2023-02-18 10:01:22,601 DEBUG [RS:1;jenkins-hbase4:44613] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/oldWALs 2023-02-18 10:01:22,601 INFO [RS:1;jenkins-hbase4:44613] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44613%2C1676714476499:(num 1676714477506) 2023-02-18 10:01:22,601 DEBUG [RS:1;jenkins-hbase4:44613] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,601 INFO [RS:1;jenkins-hbase4:44613] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:22,601 INFO [RS:1;jenkins-hbase4:44613] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:22,601 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:22,602 INFO [RS:1;jenkins-hbase4:44613] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44613 2023-02-18 10:01:22,605 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:22,605 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44613,1676714476499 2023-02-18 10:01:22,605 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e434e9a rejected from java.util.concurrent.ThreadPoolExecutor@2a7ccf8a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:22,606 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44613,1676714476499] 2023-02-18 10:01:22,606 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44613,1676714476499; numProcessing=2 2023-02-18 10:01:22,607 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44613,1676714476499 already deleted, retry=false 2023-02-18 10:01:22,607 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44613,1676714476499 expired; onlineServers=0 2023-02-18 10:01:22,607 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43321,1676714476397' ***** 2023-02-18 10:01:22,607 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:22,608 DEBUG [M:0;jenkins-hbase4:43321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@692c6ea4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:22,609 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43321,1676714476397 2023-02-18 10:01:22,609 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43321,1676714476397; all regions closed. 2023-02-18 10:01:22,609 DEBUG [M:0;jenkins-hbase4:43321] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:22,609 DEBUG [M:0;jenkins-hbase4:43321] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:22,609 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:22,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714476702] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714476702,5,FailOnTimeoutGroup] 2023-02-18 10:01:22,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714476703] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714476703,5,FailOnTimeoutGroup] 2023-02-18 10:01:22,609 DEBUG [M:0;jenkins-hbase4:43321] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:22,610 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:22,610 INFO [M:0;jenkins-hbase4:43321] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:22,610 INFO [M:0;jenkins-hbase4:43321] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:22,610 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:22,610 INFO [M:0;jenkins-hbase4:43321] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:22,610 DEBUG [M:0;jenkins-hbase4:43321] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:22,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:22,610 INFO [M:0;jenkins-hbase4:43321] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:22,611 ERROR [M:0;jenkins-hbase4:43321] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 10:01:22,611 INFO [M:0;jenkins-hbase4:43321] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:22,611 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:22,611 DEBUG [M:0;jenkins-hbase4:43321] zookeeper.ZKUtil(398): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:22,611 WARN [M:0;jenkins-hbase4:43321] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:22,611 INFO [M:0;jenkins-hbase4:43321] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:22,612 INFO [M:0;jenkins-hbase4:43321] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:22,612 DEBUG [M:0;jenkins-hbase4:43321] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:22,612 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:22,612 DEBUG [M:0;jenkins-hbase4:43321] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:22,612 DEBUG [M:0;jenkins-hbase4:43321] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:22,612 DEBUG [M:0;jenkins-hbase4:43321] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:22,612 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-18 10:01:22,621 INFO [M:0;jenkins-hbase4:43321] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/49f8926dd4fa47f3bd81adc5920f4d7d 2023-02-18 10:01:22,627 DEBUG [M:0;jenkins-hbase4:43321] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/49f8926dd4fa47f3bd81adc5920f4d7d as hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/49f8926dd4fa47f3bd81adc5920f4d7d 2023-02-18 10:01:22,631 INFO [M:0;jenkins-hbase4:43321] regionserver.HStore(1080): Added hdfs://localhost:44243/user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/49f8926dd4fa47f3bd81adc5920f4d7d, entries=31, sequenceid=218, filesize=9.0 K 2023-02-18 10:01:22,632 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-18 10:01:22,633 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:22,633 DEBUG [M:0;jenkins-hbase4:43321] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:22,636 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/31016d21-2531-26ff-92a4-8a0d6925f71e/MasterData/WALs/jenkins-hbase4.apache.org,43321,1676714476397/jenkins-hbase4.apache.org%2C43321%2C1676714476397.1676714476602 not finished, retry = 0 2023-02-18 10:01:22,738 INFO [M:0;jenkins-hbase4:43321] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:22,738 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:22,739 INFO [M:0;jenkins-hbase4:43321] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43321 2023-02-18 10:01:22,744 DEBUG [M:0;jenkins-hbase4:43321] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43321,1676714476397 already deleted, retry=false 2023-02-18 10:01:22,874 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:22,875 INFO [M:0;jenkins-hbase4:43321] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43321,1676714476397; zookeeper connection closed. 2023-02-18 10:01:22,875 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b1875e6 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:22,875 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): master:43321-0x10066e06d130000, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:22,876 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@335a1355 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:22,975 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:22,975 INFO [RS:1;jenkins-hbase4:44613] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44613,1676714476499; zookeeper connection closed. 2023-02-18 10:01:22,975 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a589ec0 rejected from java.util.concurrent.ThreadPoolExecutor@2a7ccf8a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:22,975 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:44613-0x10066e06d130002, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:22,975 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1151b4b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1151b4b 2023-02-18 10:01:22,975 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1297ae51 rejected from java.util.concurrent.ThreadPoolExecutor@2a7ccf8a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:23,075 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:23,075 INFO [RS:0;jenkins-hbase4:45301] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45301,1676714476460; zookeeper connection closed. 2023-02-18 10:01:23,075 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d320d2 rejected from java.util.concurrent.ThreadPoolExecutor@20aed502[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:23,075 DEBUG [Listener at localhost/40099-EventThread] zookeeper.ZKWatcher(600): regionserver:45301-0x10066e06d130001, quorum=127.0.0.1:58440, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:23,075 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e2b10e7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e2b10e7 2023-02-18 10:01:23,075 ERROR [Listener at localhost/40099-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@499d6a1e rejected from java.util.concurrent.ThreadPoolExecutor@20aed502[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:23,076 INFO [Listener at localhost/40099] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:23,165 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop-595646379542707736.jar 2023-02-18 10:01:23,169 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676714479201 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:23,170 DEBUG [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce 2023-02-18 10:01:23,170 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:23,170 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:23,170 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:23,170 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(239): region to add: 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=4e4618e0888ab5ba8745526cf8a075d6 as 4e4618e0888ab5ba8745526cf8a075d6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=3c6c6b5cbdbb19e67171577c77eca03a as 3c6c6b5cbdbb19e67171577c77eca03a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=6aaa0cc38e6f1bd43891541e91b24552 as 6aaa0cc38e6f1bd43891541e91b24552 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=b3a018163b86c17a0f69d59a6b8c54e7 as b3a018163b86c17a0f69d59a6b8c54e7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=db63ae0323291aea1a5456851ff123a5 as db63ae0323291aea1a5456851ff123a5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=413dcc3a5721aac783af6ee6ba69f468 as 413dcc3a5721aac783af6ee6ba69f468 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=0d48ab80dab6d54367018d48a3afced9 as 0d48ab80dab6d54367018d48a3afced9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=5c81644f06fc3bea32af1c4819e61071 as 5c81644f06fc3bea32af1c4819e61071 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=1a2f612a24cc43b17fcf44ac06b96e06 as 1a2f612a24cc43b17fcf44ac06b96e06 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,171 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(585): clone region=10b51df27a03dead14dd2735ddaf817d as 10b51df27a03dead14dd2735ddaf817d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 10:01:23,173 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b3a018163b86c17a0f69d59a6b8c54e7, NAME => 'testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,173 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4e4618e0888ab5ba8745526cf8a075d6, NAME => 'testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,174 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3c6c6b5cbdbb19e67171577c77eca03a, NAME => 'testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,174 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => db63ae0323291aea1a5456851ff123a5, NAME => 'testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,174 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 0d48ab80dab6d54367018d48a3afced9, NAME => 'testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,174 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 413dcc3a5721aac783af6ee6ba69f468, NAME => 'testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,174 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6aaa0cc38e6f1bd43891541e91b24552, NAME => 'testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,176 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 5c81644f06fc3bea32af1c4819e61071, NAME => 'testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,208 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,208 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a2f1ee3a64e45758319a3cd0cf27b78 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,217 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,217 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,217 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 86d096981f214fe78a24f675f97ce1fb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,217 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 5c81644f06fc3bea32af1c4819e61071, disabling compactions & flushes 2023-02-18 10:01:23,217 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:23,217 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:23,217 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. after waiting 0 ms 2023-02-18 10:01:23,218 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:23,218 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:23,218 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:23,218 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 1a2f612a24cc43b17fcf44ac06b96e06, NAME => 'testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,220 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4c394c0b3c1248b9b314f5ce14faaf8a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,231 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7fc4e90994af445394c4b540fa7d78a9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,235 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,235 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c96a8d6ed8124172b30f9147148c294c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,236 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 0d48ab80dab6d54367018d48a3afced9, disabling compactions & flushes 2023-02-18 10:01:23,236 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,236 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,236 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. after waiting 0 ms 2023-02-18 10:01:23,236 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,236 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,237 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:23,237 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 10b51df27a03dead14dd2735ddaf817d, NAME => 'testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,239 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,239 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96ac118cf8bb4d35af529c86c3e1384c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,240 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,240 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 697ce59d278e4ea9af2beffdd6590fa1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,244 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,245 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c92fd5a443d44b64a36286fd2db293c8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,246 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,246 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a46f6b126062485c80502e6ef5bcf73b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,246 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 479dddd52c7940e4bc760cca543f5db5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,247 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,247 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d8f22dc31b0a48d0b0119acb6aa03373 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,248 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 827998ef33224601a3dd92d31e122600 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,248 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5f4e33feb8ed4eeabf651fcc3ca1ce3e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3c6c6b5cbdbb19e67171577c77eca03a, disabling compactions & flushes 2023-02-18 10:01:23,249 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. after waiting 0 ms 2023-02-18 10:01:23,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,249 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,249 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:23,250 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f4e4556470ba4da7a0709ce493c179e6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,251 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing db63ae0323291aea1a5456851ff123a5, disabling compactions & flushes 2023-02-18 10:01:23,251 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:23,251 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:23,251 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. after waiting 0 ms 2023-02-18 10:01:23,251 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:23,251 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:23,251 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:23,252 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5bea973b409a456895b140c557f2a3cf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b3a018163b86c17a0f69d59a6b8c54e7, disabling compactions & flushes 2023-02-18 10:01:23,253 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:23,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:23,253 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d382b4b855a2429bb321ed014a75e1d3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 10:01:23,253 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. after waiting 0 ms 2023-02-18 10:01:23,254 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:23,254 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:23,254 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:23,257 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 10b51df27a03dead14dd2735ddaf817d, disabling compactions & flushes 2023-02-18 10:01:23,258 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4e4618e0888ab5ba8745526cf8a075d6, disabling compactions & flushes 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,258 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. after waiting 0 ms 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. after waiting 0 ms 2023-02-18 10:01:23,258 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 413dcc3a5721aac783af6ee6ba69f468, disabling compactions & flushes 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:23,258 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,258 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. after waiting 0 ms 2023-02-18 10:01:23,258 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 1a2f612a24cc43b17fcf44ac06b96e06, disabling compactions & flushes 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 6aaa0cc38e6f1bd43891541e91b24552, disabling compactions & flushes 2023-02-18 10:01:23,259 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:23,259 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. after waiting 0 ms 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,259 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:23,259 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:23,259 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:23,266 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:23,266 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. after waiting 0 ms 2023-02-18 10:01:23,266 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:23,266 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:23,266 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:23,267 INFO [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676714479201 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:23,267 DEBUG [Listener at localhost/40099] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,267 DEBUG [Listener at localhost/40099] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457 2023-02-18 10:01:23,268 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:23,268 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:23,269 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 10:01:23,270 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------0d48ab80dab6d54367018d48a3afced9/ 2023-02-18 10:01:23,270 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,271 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,271 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=0d48ab80dab6d54367018d48a3afced9-5a2f1ee3a64e45758319a3cd0cf27b78 2023-02-18 10:01:23,271 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,272 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=0d48ab80dab6d54367018d48a3afced9-4c394c0b3c1248b9b314f5ce14faaf8a 2023-02-18 10:01:23,272 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------10b51df27a03dead14dd2735ddaf817d/ 2023-02-18 10:01:23,272 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,272 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------1a2f612a24cc43b17fcf44ac06b96e06/ 2023-02-18 10:01:23,273 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,273 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,274 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=1a2f612a24cc43b17fcf44ac06b96e06-d8f22dc31b0a48d0b0119acb6aa03373 2023-02-18 10:01:23,274 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,274 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=1a2f612a24cc43b17fcf44ac06b96e06-5bea973b409a456895b140c557f2a3cf 2023-02-18 10:01:23,274 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------3c6c6b5cbdbb19e67171577c77eca03a/ 2023-02-18 10:01:23,275 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,275 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,275 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=3c6c6b5cbdbb19e67171577c77eca03a-86d096981f214fe78a24f675f97ce1fb 2023-02-18 10:01:23,275 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,276 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=3c6c6b5cbdbb19e67171577c77eca03a-7fc4e90994af445394c4b540fa7d78a9 2023-02-18 10:01:23,276 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------413dcc3a5721aac783af6ee6ba69f468/ 2023-02-18 10:01:23,277 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,277 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,277 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=413dcc3a5721aac783af6ee6ba69f468-479dddd52c7940e4bc760cca543f5db5 2023-02-18 10:01:23,277 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,278 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=413dcc3a5721aac783af6ee6ba69f468-d382b4b855a2429bb321ed014a75e1d3 2023-02-18 10:01:23,278 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------4e4618e0888ab5ba8745526cf8a075d6/ 2023-02-18 10:01:23,278 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,278 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,279 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=4e4618e0888ab5ba8745526cf8a075d6-96ac118cf8bb4d35af529c86c3e1384c 2023-02-18 10:01:23,279 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,279 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=4e4618e0888ab5ba8745526cf8a075d6-5f4e33feb8ed4eeabf651fcc3ca1ce3e 2023-02-18 10:01:23,279 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------5c81644f06fc3bea32af1c4819e61071/ 2023-02-18 10:01:23,280 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,280 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------6aaa0cc38e6f1bd43891541e91b24552/ 2023-02-18 10:01:23,281 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,281 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,281 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=6aaa0cc38e6f1bd43891541e91b24552-c92fd5a443d44b64a36286fd2db293c8 2023-02-18 10:01:23,281 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,282 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=6aaa0cc38e6f1bd43891541e91b24552-f4e4556470ba4da7a0709ce493c179e6 2023-02-18 10:01:23,282 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------b3a018163b86c17a0f69d59a6b8c54e7/ 2023-02-18 10:01:23,282 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,282 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,283 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=b3a018163b86c17a0f69d59a6b8c54e7-697ce59d278e4ea9af2beffdd6590fa1 2023-02-18 10:01:23,283 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,283 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=b3a018163b86c17a0f69d59a6b8c54e7-827998ef33224601a3dd92d31e122600 2023-02-18 10:01:23,283 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |----------db63ae0323291aea1a5456851ff123a5/ 2023-02-18 10:01:23,284 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:23,284 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:23,284 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=db63ae0323291aea1a5456851ff123a5-c96a8d6ed8124172b30f9147148c294c 2023-02-18 10:01:23,284 DEBUG [Listener at localhost/40099] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:23,285 DEBUG [Listener at localhost/40099] util.CommonFSUtils(702): |----------------testWithMapReduce=db63ae0323291aea1a5456851ff123a5-a46f6b126062485c80502e6ef5bcf73b 2023-02-18 10:01:23,285 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,286 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,287 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,287 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,288 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,288 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,289 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,360 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop-7553457044403278431.jar 2023-02-18 10:01:23,361 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,361 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,361 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,362 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,362 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,362 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,363 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 10:01:23,363 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 10:01:23,363 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 10:01:23,364 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 10:01:23,364 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 10:01:23,365 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 10:01:23,365 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 10:01:23,365 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 10:01:23,365 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 10:01:23,366 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 10:01:23,366 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:23,367 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:23,367 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:23,367 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:23,368 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 10:01:23,437 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop-8527648035160127521.jar 2023-02-18 10:01:23,438 DEBUG [Listener at localhost/40099] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 10:01:23,444 WARN [Listener at localhost/40099] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 10:01:23,479 INFO [Listener at localhost/40099] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 10:01:23,631 WARN [Listener at localhost/40099] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/mapreduce.cluster.local.dir/1676714483585/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 10:01:23,631 WARN [Listener at localhost/40099] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/mapreduce.cluster.local.dir/1676714483585/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 10:01:23,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,671 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:23,672 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:23,674 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:23,676 DEBUG [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/f1 2023-02-18 10:01:23,676 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10b51df27a03dead14dd2735ddaf817d columnFamilyName f1 2023-02-18 10:01:23,677 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(310): Store=10b51df27a03dead14dd2735ddaf817d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,677 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10b51df27a03dead14dd2735ddaf817d 2023-02-18 10:01:23,681 DEBUG [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/10b51df27a03dead14dd2735ddaf817d/f2 2023-02-18 10:01:23,681 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10b51df27a03dead14dd2735ddaf817d columnFamilyName f2 2023-02-18 10:01:23,682 INFO [StoreOpener-10b51df27a03dead14dd2735ddaf817d-1] regionserver.HStore(310): Store=10b51df27a03dead14dd2735ddaf817d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,682 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:23,682 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 10b51df27a03dead14dd2735ddaf817d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72145815, jitterRate=0.07505641877651215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:23,682 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:23,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 10b51df27a03dead14dd2735ddaf817d, disabling compactions & flushes 2023-02-18 10:01:23,700 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. after waiting 0 ms 2023-02-18 10:01:23,700 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,701 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676714477854.10b51df27a03dead14dd2735ddaf817d. 2023-02-18 10:01:23,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 10b51df27a03dead14dd2735ddaf817d: 2023-02-18 10:01:23,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,706 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:23,712 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:23,716 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:23,717 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1 2023-02-18 10:01:23,717 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c6c6b5cbdbb19e67171577c77eca03a columnFamilyName f1 2023-02-18 10:01:23,725 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f1/testWithMapReduce=3c6c6b5cbdbb19e67171577c77eca03a-86d096981f214fe78a24f675f97ce1fb 2023-02-18 10:01:23,725 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(310): Store=3c6c6b5cbdbb19e67171577c77eca03a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,725 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c6c6b5cbdbb19e67171577c77eca03a 2023-02-18 10:01:23,726 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2 2023-02-18 10:01:23,726 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c6c6b5cbdbb19e67171577c77eca03a columnFamilyName f2 2023-02-18 10:01:23,731 DEBUG [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/3c6c6b5cbdbb19e67171577c77eca03a/f2/testWithMapReduce=3c6c6b5cbdbb19e67171577c77eca03a-7fc4e90994af445394c4b540fa7d78a9 2023-02-18 10:01:23,732 INFO [StoreOpener-3c6c6b5cbdbb19e67171577c77eca03a-1] regionserver.HStore(310): Store=3c6c6b5cbdbb19e67171577c77eca03a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:23,732 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3c6c6b5cbdbb19e67171577c77eca03a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68656379, jitterRate=0.023059770464897156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:23,732 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:23,769 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3c6c6b5cbdbb19e67171577c77eca03a, disabling compactions & flushes 2023-02-18 10:01:23,770 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. after waiting 0 ms 2023-02-18 10:01:23,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,772 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676714477854.3c6c6b5cbdbb19e67171577c77eca03a. 2023-02-18 10:01:23,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3c6c6b5cbdbb19e67171577c77eca03a: 2023-02-18 10:01:23,775 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,775 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:23,784 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:23,786 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:23,787 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1 2023-02-18 10:01:23,787 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d48ab80dab6d54367018d48a3afced9 columnFamilyName f1 2023-02-18 10:01:23,793 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f1/testWithMapReduce=0d48ab80dab6d54367018d48a3afced9-5a2f1ee3a64e45758319a3cd0cf27b78 2023-02-18 10:01:23,793 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(310): Store=0d48ab80dab6d54367018d48a3afced9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,793 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d48ab80dab6d54367018d48a3afced9 2023-02-18 10:01:23,794 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2 2023-02-18 10:01:23,794 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d48ab80dab6d54367018d48a3afced9 columnFamilyName f2 2023-02-18 10:01:23,799 DEBUG [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/0d48ab80dab6d54367018d48a3afced9/f2/testWithMapReduce=0d48ab80dab6d54367018d48a3afced9-4c394c0b3c1248b9b314f5ce14faaf8a 2023-02-18 10:01:23,799 INFO [StoreOpener-0d48ab80dab6d54367018d48a3afced9-1] regionserver.HStore(310): Store=0d48ab80dab6d54367018d48a3afced9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,799 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:23,799 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0d48ab80dab6d54367018d48a3afced9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62210044, jitterRate=-0.07299810647964478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:23,800 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:23,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0d48ab80dab6d54367018d48a3afced9, disabling compactions & flushes 2023-02-18 10:01:23,847 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. after waiting 0 ms 2023-02-18 10:01:23,848 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,848 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676714477854.0d48ab80dab6d54367018d48a3afced9. 2023-02-18 10:01:23,849 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0d48ab80dab6d54367018d48a3afced9: 2023-02-18 10:01:23,854 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,854 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:23,857 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:23,859 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:23,860 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1 2023-02-18 10:01:23,860 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a2f612a24cc43b17fcf44ac06b96e06 columnFamilyName f1 2023-02-18 10:01:23,866 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f1/testWithMapReduce=1a2f612a24cc43b17fcf44ac06b96e06-d8f22dc31b0a48d0b0119acb6aa03373 2023-02-18 10:01:23,866 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(310): Store=1a2f612a24cc43b17fcf44ac06b96e06/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,866 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1a2f612a24cc43b17fcf44ac06b96e06 2023-02-18 10:01:23,867 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2 2023-02-18 10:01:23,867 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a2f612a24cc43b17fcf44ac06b96e06 columnFamilyName f2 2023-02-18 10:01:23,872 DEBUG [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/1a2f612a24cc43b17fcf44ac06b96e06/f2/testWithMapReduce=1a2f612a24cc43b17fcf44ac06b96e06-5bea973b409a456895b140c557f2a3cf 2023-02-18 10:01:23,872 INFO [StoreOpener-1a2f612a24cc43b17fcf44ac06b96e06-1] regionserver.HStore(310): Store=1a2f612a24cc43b17fcf44ac06b96e06/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,872 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:23,872 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1a2f612a24cc43b17fcf44ac06b96e06; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64376589, jitterRate=-0.040714070200920105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:23,872 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:23,899 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1a2f612a24cc43b17fcf44ac06b96e06, disabling compactions & flushes 2023-02-18 10:01:23,900 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. after waiting 0 ms 2023-02-18 10:01:23,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,901 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676714477854.1a2f612a24cc43b17fcf44ac06b96e06. 2023-02-18 10:01:23,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1a2f612a24cc43b17fcf44ac06b96e06: 2023-02-18 10:01:23,906 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,906 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:23,908 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:23,912 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:23,914 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1 2023-02-18 10:01:23,914 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 413dcc3a5721aac783af6ee6ba69f468 columnFamilyName f1 2023-02-18 10:01:23,920 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f1/testWithMapReduce=413dcc3a5721aac783af6ee6ba69f468-479dddd52c7940e4bc760cca543f5db5 2023-02-18 10:01:23,920 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(310): Store=413dcc3a5721aac783af6ee6ba69f468/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,920 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 413dcc3a5721aac783af6ee6ba69f468 2023-02-18 10:01:23,921 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2 2023-02-18 10:01:23,922 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 413dcc3a5721aac783af6ee6ba69f468 columnFamilyName f2 2023-02-18 10:01:23,927 DEBUG [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/413dcc3a5721aac783af6ee6ba69f468/f2/testWithMapReduce=413dcc3a5721aac783af6ee6ba69f468-d382b4b855a2429bb321ed014a75e1d3 2023-02-18 10:01:23,927 INFO [StoreOpener-413dcc3a5721aac783af6ee6ba69f468-1] regionserver.HStore(310): Store=413dcc3a5721aac783af6ee6ba69f468/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:23,928 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 413dcc3a5721aac783af6ee6ba69f468; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60511431, jitterRate=-0.09830941259860992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:23,928 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:23,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 413dcc3a5721aac783af6ee6ba69f468, disabling compactions & flushes 2023-02-18 10:01:23,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. after waiting 0 ms 2023-02-18 10:01:23,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,967 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676714477854.413dcc3a5721aac783af6ee6ba69f468. 2023-02-18 10:01:23,968 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 413dcc3a5721aac783af6ee6ba69f468: 2023-02-18 10:01:23,974 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:23,974 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:23,976 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:23,978 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:23,979 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1 2023-02-18 10:01:23,979 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4618e0888ab5ba8745526cf8a075d6 columnFamilyName f1 2023-02-18 10:01:23,984 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f1/testWithMapReduce=4e4618e0888ab5ba8745526cf8a075d6-96ac118cf8bb4d35af529c86c3e1384c 2023-02-18 10:01:23,984 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(310): Store=4e4618e0888ab5ba8745526cf8a075d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,985 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e4618e0888ab5ba8745526cf8a075d6 2023-02-18 10:01:23,986 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2 2023-02-18 10:01:23,986 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e4618e0888ab5ba8745526cf8a075d6 columnFamilyName f2 2023-02-18 10:01:23,991 DEBUG [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/4e4618e0888ab5ba8745526cf8a075d6/f2/testWithMapReduce=4e4618e0888ab5ba8745526cf8a075d6-5f4e33feb8ed4eeabf651fcc3ca1ce3e 2023-02-18 10:01:23,991 INFO [StoreOpener-4e4618e0888ab5ba8745526cf8a075d6-1] regionserver.HStore(310): Store=4e4618e0888ab5ba8745526cf8a075d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:23,991 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:23,992 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4e4618e0888ab5ba8745526cf8a075d6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69649752, jitterRate=0.037862181663513184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:23,992 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:24,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4e4618e0888ab5ba8745526cf8a075d6, disabling compactions & flushes 2023-02-18 10:01:24,026 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:24,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:24,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. after waiting 0 ms 2023-02-18 10:01:24,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:24,027 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676714477854.4e4618e0888ab5ba8745526cf8a075d6. 2023-02-18 10:01:24,027 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4e4618e0888ab5ba8745526cf8a075d6: 2023-02-18 10:01:24,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:24,030 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:24,032 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:24,035 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:24,036 DEBUG [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/f1 2023-02-18 10:01:24,037 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c81644f06fc3bea32af1c4819e61071 columnFamilyName f1 2023-02-18 10:01:24,037 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(310): Store=5c81644f06fc3bea32af1c4819e61071/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,037 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5c81644f06fc3bea32af1c4819e61071 2023-02-18 10:01:24,039 DEBUG [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/5c81644f06fc3bea32af1c4819e61071/f2 2023-02-18 10:01:24,040 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c81644f06fc3bea32af1c4819e61071 columnFamilyName f2 2023-02-18 10:01:24,040 INFO [StoreOpener-5c81644f06fc3bea32af1c4819e61071-1] regionserver.HStore(310): Store=5c81644f06fc3bea32af1c4819e61071/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:24,041 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5c81644f06fc3bea32af1c4819e61071; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60696039, jitterRate=-0.0955585390329361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:24,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:24,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5c81644f06fc3bea32af1c4819e61071, disabling compactions & flushes 2023-02-18 10:01:24,068 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:24,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:24,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. after waiting 0 ms 2023-02-18 10:01:24,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:24,069 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714477854.5c81644f06fc3bea32af1c4819e61071. 2023-02-18 10:01:24,069 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5c81644f06fc3bea32af1c4819e61071: 2023-02-18 10:01:24,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:24,073 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:24,080 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:24,082 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:24,083 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1 2023-02-18 10:01:24,083 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3a018163b86c17a0f69d59a6b8c54e7 columnFamilyName f1 2023-02-18 10:01:24,088 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f1/testWithMapReduce=b3a018163b86c17a0f69d59a6b8c54e7-697ce59d278e4ea9af2beffdd6590fa1 2023-02-18 10:01:24,088 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(310): Store=b3a018163b86c17a0f69d59a6b8c54e7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,089 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3a018163b86c17a0f69d59a6b8c54e7 2023-02-18 10:01:24,090 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2 2023-02-18 10:01:24,090 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3a018163b86c17a0f69d59a6b8c54e7 columnFamilyName f2 2023-02-18 10:01:24,095 DEBUG [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/b3a018163b86c17a0f69d59a6b8c54e7/f2/testWithMapReduce=b3a018163b86c17a0f69d59a6b8c54e7-827998ef33224601a3dd92d31e122600 2023-02-18 10:01:24,095 INFO [StoreOpener-b3a018163b86c17a0f69d59a6b8c54e7-1] regionserver.HStore(310): Store=b3a018163b86c17a0f69d59a6b8c54e7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:24,095 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b3a018163b86c17a0f69d59a6b8c54e7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59277783, jitterRate=-0.1166922003030777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:24,095 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:24,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b3a018163b86c17a0f69d59a6b8c54e7, disabling compactions & flushes 2023-02-18 10:01:24,125 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:24,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:24,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. after waiting 0 ms 2023-02-18 10:01:24,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:24,125 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676714477854.b3a018163b86c17a0f69d59a6b8c54e7. 2023-02-18 10:01:24,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b3a018163b86c17a0f69d59a6b8c54e7: 2023-02-18 10:01:24,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:24,128 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:24,129 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:24,131 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:24,132 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1 2023-02-18 10:01:24,132 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aaa0cc38e6f1bd43891541e91b24552 columnFamilyName f1 2023-02-18 10:01:24,137 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f1/testWithMapReduce=6aaa0cc38e6f1bd43891541e91b24552-c92fd5a443d44b64a36286fd2db293c8 2023-02-18 10:01:24,137 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(310): Store=6aaa0cc38e6f1bd43891541e91b24552/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,137 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6aaa0cc38e6f1bd43891541e91b24552 2023-02-18 10:01:24,138 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2 2023-02-18 10:01:24,138 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aaa0cc38e6f1bd43891541e91b24552 columnFamilyName f2 2023-02-18 10:01:24,142 DEBUG [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/6aaa0cc38e6f1bd43891541e91b24552/f2/testWithMapReduce=6aaa0cc38e6f1bd43891541e91b24552-f4e4556470ba4da7a0709ce493c179e6 2023-02-18 10:01:24,142 INFO [StoreOpener-6aaa0cc38e6f1bd43891541e91b24552-1] regionserver.HStore(310): Store=6aaa0cc38e6f1bd43891541e91b24552/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:24,143 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6aaa0cc38e6f1bd43891541e91b24552; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64679089, jitterRate=-0.03620646893978119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:24,143 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:24,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6aaa0cc38e6f1bd43891541e91b24552, disabling compactions & flushes 2023-02-18 10:01:24,169 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:24,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:24,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. after waiting 0 ms 2023-02-18 10:01:24,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:24,170 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676714477854.6aaa0cc38e6f1bd43891541e91b24552. 2023-02-18 10:01:24,170 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6aaa0cc38e6f1bd43891541e91b24552: 2023-02-18 10:01:24,173 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:24,173 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:24,174 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:24,177 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:24,177 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1 2023-02-18 10:01:24,178 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db63ae0323291aea1a5456851ff123a5 columnFamilyName f1 2023-02-18 10:01:24,182 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f1/testWithMapReduce=db63ae0323291aea1a5456851ff123a5-c96a8d6ed8124172b30f9147148c294c 2023-02-18 10:01:24,182 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(310): Store=db63ae0323291aea1a5456851ff123a5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,182 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region db63ae0323291aea1a5456851ff123a5 2023-02-18 10:01:24,183 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2 2023-02-18 10:01:24,183 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db63ae0323291aea1a5456851ff123a5 columnFamilyName f2 2023-02-18 10:01:24,188 DEBUG [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(539): loaded hdfs://localhost:44243/user/jenkins/test-data/d551fad3-1063-12d4-5ff6-73c2c15bedbf/testWithMapReduceAndOfflineHBaseMultiRegion/6a327261-72b8-4408-b77d-bfdbc081d457/data/default/testWithMapReduce/db63ae0323291aea1a5456851ff123a5/f2/testWithMapReduce=db63ae0323291aea1a5456851ff123a5-a46f6b126062485c80502e6ef5bcf73b 2023-02-18 10:01:24,188 INFO [StoreOpener-db63ae0323291aea1a5456851ff123a5-1] regionserver.HStore(310): Store=db63ae0323291aea1a5456851ff123a5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:24,188 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:24,189 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened db63ae0323291aea1a5456851ff123a5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64785686, jitterRate=-0.03461804986000061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:24,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:24,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing db63ae0323291aea1a5456851ff123a5, disabling compactions & flushes 2023-02-18 10:01:24,218 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:24,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:24,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. after waiting 0 ms 2023-02-18 10:01:24,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:24,219 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676714477854.db63ae0323291aea1a5456851ff123a5. 2023-02-18 10:01:24,219 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for db63ae0323291aea1a5456851ff123a5: 2023-02-18 10:01:24,672 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:24,672 WARN [Listener at localhost/40099] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:24,675 INFO [Listener at localhost/40099] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:24,779 WARN [BP-976225822-172.31.14.131-1676714475768 heartbeating to localhost/127.0.0.1:44243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:24,779 WARN [BP-976225822-172.31.14.131-1676714475768 heartbeating to localhost/127.0.0.1:44243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-976225822-172.31.14.131-1676714475768 (Datanode Uuid 3ef5756d-5ac1-4ba7-80a4-c9c5e75ebb58) service to localhost/127.0.0.1:44243 2023-02-18 10:01:24,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/dfs/data/data3/current/BP-976225822-172.31.14.131-1676714475768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:24,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/dfs/data/data4/current/BP-976225822-172.31.14.131-1676714475768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:24,782 WARN [Listener at localhost/40099] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:24,790 INFO [Listener at localhost/40099] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:24,895 WARN [BP-976225822-172.31.14.131-1676714475768 heartbeating to localhost/127.0.0.1:44243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:24,895 WARN [BP-976225822-172.31.14.131-1676714475768 heartbeating to localhost/127.0.0.1:44243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-976225822-172.31.14.131-1676714475768 (Datanode Uuid d12e09d9-a20a-4183-9651-5cb03664cacc) service to localhost/127.0.0.1:44243 2023-02-18 10:01:24,896 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/dfs/data/data1/current/BP-976225822-172.31.14.131-1676714475768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:24,896 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/cluster_9283f188-78fb-f16d-19f9-998bb0f5d0cb/dfs/data/data2/current/BP-976225822-172.31.14.131-1676714475768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:24,906 INFO [Listener at localhost/40099] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:25,027 INFO [Listener at localhost/40099] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:25,073 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:25,087 INFO [Listener at localhost/40099] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=156 (was 103) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44243 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43321,1676714476397)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40099 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:44243 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44243 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44243 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:44243 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=534 (was 538), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 268), ProcessCount=170 (was 170), AvailableMemoryMB=8879 (was 9424) 2023-02-18 10:01:25,098 INFO [Listener at localhost/40099] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=534, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=170, AvailableMemoryMB=8879 2023-02-18 10:01:25,108 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop.log.dir so I do NOT create it in target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6 2023-02-18 10:01:25,108 WARN [Listener at localhost/40099] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 10:01:25,108 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop.tmp.dir so I do NOT create it in target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6 2023-02-18 10:01:25,108 WARN [Listener at localhost/40099] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d0d23bd9-d2fc-0aa6-75da-379c5f8f1ba0/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 10:01:25,108 DEBUG [Listener at localhost/40099] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6 2023-02-18 10:01:25,108 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:01:25,108 INFO [Listener at localhost/40099] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8, deleteOnExit=true 2023-02-18 10:01:25,108 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/test.cache.data in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:01:25,109 DEBUG [Listener at localhost/40099] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:25,109 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:01:25,110 INFO [Listener at localhost/40099] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:01:25,114 WARN [Listener at localhost/40099] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:25,115 WARN [Listener at localhost/40099] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:25,153 WARN [Listener at localhost/40099] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:25,155 INFO [Listener at localhost/40099] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:25,162 INFO [Listener at localhost/40099] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/java.io.tmpdir/Jetty_localhost_45081_hdfs____.nvuxa/webapp 2023-02-18 10:01:25,273 INFO [Listener at localhost/40099] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45081 2023-02-18 10:01:25,314 WARN [Listener at localhost/40099] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:25,314 WARN [Listener at localhost/40099] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:25,358 WARN [Listener at localhost/45785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:25,368 WARN [Listener at localhost/45785] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:25,371 WARN [Listener at localhost/45785] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:25,372 INFO [Listener at localhost/45785] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:25,377 INFO [Listener at localhost/45785] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/java.io.tmpdir/Jetty_localhost_42753_datanode____.rn91aa/webapp 2023-02-18 10:01:25,470 INFO [Listener at localhost/45785] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42753 2023-02-18 10:01:25,477 WARN [Listener at localhost/43521] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:25,489 WARN [Listener at localhost/43521] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:25,491 WARN [Listener at localhost/43521] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:25,492 INFO [Listener at localhost/43521] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:25,497 INFO [Listener at localhost/43521] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/java.io.tmpdir/Jetty_localhost_35907_datanode____.33hs57/webapp 2023-02-18 10:01:25,579 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa3a63093bce3af38: Processing first storage report for DS-553a95ea-e500-4cbd-b399-b8da9884ea46 from datanode e9f75d2d-706e-4bb6-b4d5-0a350df8e946 2023-02-18 10:01:25,580 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa3a63093bce3af38: from storage DS-553a95ea-e500-4cbd-b399-b8da9884ea46 node DatanodeRegistration(127.0.0.1:44961, datanodeUuid=e9f75d2d-706e-4bb6-b4d5-0a350df8e946, infoPort=37139, infoSecurePort=0, ipcPort=43521, storageInfo=lv=-57;cid=testClusterID;nsid=1318740707;c=1676714485117), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:25,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa3a63093bce3af38: Processing first storage report for DS-85982091-701f-47e7-b01f-7e2df61f70e9 from datanode e9f75d2d-706e-4bb6-b4d5-0a350df8e946 2023-02-18 10:01:25,580 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa3a63093bce3af38: from storage DS-85982091-701f-47e7-b01f-7e2df61f70e9 node DatanodeRegistration(127.0.0.1:44961, datanodeUuid=e9f75d2d-706e-4bb6-b4d5-0a350df8e946, infoPort=37139, infoSecurePort=0, ipcPort=43521, storageInfo=lv=-57;cid=testClusterID;nsid=1318740707;c=1676714485117), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:25,596 INFO [Listener at localhost/43521] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35907 2023-02-18 10:01:25,604 WARN [Listener at localhost/43885] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:25,691 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x10ea69f1a6c13df4: Processing first storage report for DS-b52320cd-43e7-4cac-9377-01818c22435b from datanode 0cc62f6a-a66a-48e0-8345-cccccc16fdf2 2023-02-18 10:01:25,691 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x10ea69f1a6c13df4: from storage DS-b52320cd-43e7-4cac-9377-01818c22435b node DatanodeRegistration(127.0.0.1:45127, datanodeUuid=0cc62f6a-a66a-48e0-8345-cccccc16fdf2, infoPort=40667, infoSecurePort=0, ipcPort=43885, storageInfo=lv=-57;cid=testClusterID;nsid=1318740707;c=1676714485117), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:25,692 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x10ea69f1a6c13df4: Processing first storage report for DS-9010aa3a-8e3f-4ba9-84bb-8ddb46eeb6f1 from datanode 0cc62f6a-a66a-48e0-8345-cccccc16fdf2 2023-02-18 10:01:25,692 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x10ea69f1a6c13df4: from storage DS-9010aa3a-8e3f-4ba9-84bb-8ddb46eeb6f1 node DatanodeRegistration(127.0.0.1:45127, datanodeUuid=0cc62f6a-a66a-48e0-8345-cccccc16fdf2, infoPort=40667, infoSecurePort=0, ipcPort=43885, storageInfo=lv=-57;cid=testClusterID;nsid=1318740707;c=1676714485117), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:25,711 DEBUG [Listener at localhost/43885] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6 2023-02-18 10:01:25,714 INFO [Listener at localhost/43885] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/zookeeper_0, clientPort=55307, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:01:25,715 INFO [Listener at localhost/43885] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55307 2023-02-18 10:01:25,715 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,716 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,728 INFO [Listener at localhost/43885] util.FSUtils(479): Created version file at hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a with version=8 2023-02-18 10:01:25,728 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,729 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,730 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45785/user/jenkins/test-data/135fb61f-0a4b-080e-fa42-0c6b8f3c1ffd/hbase-staging 2023-02-18 10:01:25,731 INFO [Listener at localhost/43885] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:25,731 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,731 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,731 INFO [Listener at localhost/43885] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:25,731 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,732 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:25,732 INFO [Listener at localhost/43885] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:25,733 INFO [Listener at localhost/43885] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44503 2023-02-18 10:01:25,733 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,734 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,735 INFO [Listener at localhost/43885] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44503 connecting to ZooKeeper ensemble=127.0.0.1:55307 2023-02-18 10:01:25,742 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:445030x0, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:25,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44503-0x10066e091960000 connected 2023-02-18 10:01:25,759 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:25,759 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:25,760 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:25,760 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44503 2023-02-18 10:01:25,760 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44503 2023-02-18 10:01:25,761 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44503 2023-02-18 10:01:25,761 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44503 2023-02-18 10:01:25,761 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44503 2023-02-18 10:01:25,761 INFO [Listener at localhost/43885] master.HMaster(444): hbase.rootdir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a, hbase.cluster.distributed=false 2023-02-18 10:01:25,773 INFO [Listener at localhost/43885] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:25,773 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,773 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,773 INFO [Listener at localhost/43885] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:25,773 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,774 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:25,774 INFO [Listener at localhost/43885] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:25,775 INFO [Listener at localhost/43885] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34371 2023-02-18 10:01:25,776 INFO [Listener at localhost/43885] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:25,777 DEBUG [Listener at localhost/43885] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:25,777 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,779 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,780 INFO [Listener at localhost/43885] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34371 connecting to ZooKeeper ensemble=127.0.0.1:55307 2023-02-18 10:01:25,783 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:343710x0, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:25,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34371-0x10066e091960001 connected 2023-02-18 10:01:25,784 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:25,785 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:25,785 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:25,788 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34371 2023-02-18 10:01:25,788 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34371 2023-02-18 10:01:25,788 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34371 2023-02-18 10:01:25,789 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34371 2023-02-18 10:01:25,789 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34371 2023-02-18 10:01:25,799 INFO [Listener at localhost/43885] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:25,799 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,799 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,799 INFO [Listener at localhost/43885] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:25,799 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:25,800 INFO [Listener at localhost/43885] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:25,800 INFO [Listener at localhost/43885] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:25,803 INFO [Listener at localhost/43885] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40603 2023-02-18 10:01:25,804 INFO [Listener at localhost/43885] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:25,804 DEBUG [Listener at localhost/43885] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:25,805 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,806 INFO [Listener at localhost/43885] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,806 INFO [Listener at localhost/43885] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40603 connecting to ZooKeeper ensemble=127.0.0.1:55307 2023-02-18 10:01:25,809 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:406030x0, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:25,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40603-0x10066e091960002 connected 2023-02-18 10:01:25,812 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:25,813 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:25,814 DEBUG [Listener at localhost/43885] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:25,814 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40603 2023-02-18 10:01:25,814 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40603 2023-02-18 10:01:25,817 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40603 2023-02-18 10:01:25,818 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40603 2023-02-18 10:01:25,819 DEBUG [Listener at localhost/43885] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40603 2023-02-18 10:01:25,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,822 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:25,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,826 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:25,826 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:25,826 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:25,827 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:25,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:25,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44503,1676714485731 from backup master directory 2023-02-18 10:01:25,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:25,830 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,830 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:25,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,830 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:25,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/hbase.id with ID: f549140e-e989-40ad-825c-4b4627433238 2023-02-18 10:01:25,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:25,852 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:25,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4aac19c1 to 127.0.0.1:55307 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:25,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c1bb589, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:25,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:25,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:25,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:25,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store-tmp 2023-02-18 10:01:25,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:25,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:25,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:25,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:25,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:25,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:25,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:25,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:25,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/WALs/jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44503%2C1676714485731, suffix=, logDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/WALs/jenkins-hbase4.apache.org,44503,1676714485731, archiveDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:25,892 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK] 2023-02-18 10:01:25,893 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK] 2023-02-18 10:01:25,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/WALs/jenkins-hbase4.apache.org,44503,1676714485731/jenkins-hbase4.apache.org%2C44503%2C1676714485731.1676714485878 2023-02-18 10:01:25,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK], DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK]] 2023-02-18 10:01:25,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:25,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:25,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:25,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:25,897 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:25,898 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:25,898 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:25,899 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:25,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:25,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:25,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:25,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:25,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75090627, jitterRate=0.11893753707408905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:25,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:25,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:25,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:25,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:25,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:25,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 10:01:25,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 10:01:25,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:25,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:25,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:25,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:25,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:25,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:25,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:25,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:25,924 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:25,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:25,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:25,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:25,927 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:25,927 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:25,927 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:25,927 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:25,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44503,1676714485731, sessionid=0x10066e091960000, setting cluster-up flag (Was=false) 2023-02-18 10:01:25,932 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:25,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:25,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,941 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:25,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:25,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:25,946 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.hbase-snapshot/.tmp 2023-02-18 10:01:25,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:25,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714515949 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:25,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:25,950 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:25,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:25,951 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:25,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:25,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:25,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:25,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:25,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714485952,5,FailOnTimeoutGroup] 2023-02-18 10:01:25,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714485952,5,FailOnTimeoutGroup] 2023-02-18 10:01:25,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:25,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:25,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:25,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:25,953 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:25,969 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:25,970 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:25,970 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a 2023-02-18 10:01:25,982 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:25,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:25,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/info 2023-02-18 10:01:25,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:25,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:25,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:25,987 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:25,987 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:25,988 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:25,988 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:25,989 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/table 2023-02-18 10:01:25,989 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:25,989 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:25,990 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740 2023-02-18 10:01:25,990 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740 2023-02-18 10:01:25,993 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:25,995 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:25,997 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:25,998 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75395371, jitterRate=0.12347857654094696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:25,998 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:25,998 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:25,998 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:25,998 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:25,998 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:25,998 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:25,998 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:25,998 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:25,999 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:25,999 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:26,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:26,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:26,006 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:26,022 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(952): ClusterId : f549140e-e989-40ad-825c-4b4627433238 2023-02-18 10:01:26,022 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(952): ClusterId : f549140e-e989-40ad-825c-4b4627433238 2023-02-18 10:01:26,022 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:26,022 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:26,026 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:26,026 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:26,028 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:26,029 DEBUG [RS:0;jenkins-hbase4:34371] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc38f77 to 127.0.0.1:55307 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:26,029 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:26,030 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:26,033 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:26,034 DEBUG [RS:1;jenkins-hbase4:40603] zookeeper.ReadOnlyZKClient(139): Connect 0x544df045 to 127.0.0.1:55307 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:26,036 DEBUG [RS:0;jenkins-hbase4:34371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504707f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:26,038 DEBUG [RS:0;jenkins-hbase4:34371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13be407, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:26,040 DEBUG [RS:1;jenkins-hbase4:40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a8a04bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:26,040 DEBUG [RS:1;jenkins-hbase4:40603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eb59b35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:26,049 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34371 2023-02-18 10:01:26,049 INFO [RS:0;jenkins-hbase4:34371] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:26,049 INFO [RS:0;jenkins-hbase4:34371] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:26,049 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:26,049 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44503,1676714485731 with isa=jenkins-hbase4.apache.org/172.31.14.131:34371, startcode=1676714485773 2023-02-18 10:01:26,050 DEBUG [RS:0;jenkins-hbase4:34371] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:26,051 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40603 2023-02-18 10:01:26,051 INFO [RS:1;jenkins-hbase4:40603] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:26,051 INFO [RS:1;jenkins-hbase4:40603] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:26,051 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:26,052 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57441, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:26,052 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44503,1676714485731 with isa=jenkins-hbase4.apache.org/172.31.14.131:40603, startcode=1676714485799 2023-02-18 10:01:26,052 DEBUG [RS:1;jenkins-hbase4:40603] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:26,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,055 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a 2023-02-18 10:01:26,055 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45785 2023-02-18 10:01:26,055 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:26,056 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47103, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:26,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,057 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:26,057 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a 2023-02-18 10:01:26,057 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45785 2023-02-18 10:01:26,057 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:26,058 DEBUG [RS:0;jenkins-hbase4:34371] zookeeper.ZKUtil(162): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,058 WARN [RS:0;jenkins-hbase4:34371] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:26,058 INFO [RS:0;jenkins-hbase4:34371] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:26,058 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,064 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40603,1676714485799] 2023-02-18 10:01:26,064 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34371,1676714485773] 2023-02-18 10:01:26,067 DEBUG [RS:0;jenkins-hbase4:34371] zookeeper.ZKUtil(162): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,068 DEBUG [RS:0;jenkins-hbase4:34371] zookeeper.ZKUtil(162): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,068 DEBUG [RS:1;jenkins-hbase4:40603] zookeeper.ZKUtil(162): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,068 WARN [RS:1;jenkins-hbase4:40603] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:26,068 INFO [RS:1;jenkins-hbase4:40603] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:26,068 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,068 DEBUG [RS:0;jenkins-hbase4:34371] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:26,069 INFO [RS:0;jenkins-hbase4:34371] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:26,073 INFO [RS:0;jenkins-hbase4:34371] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:26,074 INFO [RS:0;jenkins-hbase4:34371] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:26,074 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,078 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:26,080 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,081 DEBUG [RS:0;jenkins-hbase4:34371] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,082 DEBUG [RS:1;jenkins-hbase4:40603] zookeeper.ZKUtil(162): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,082 DEBUG [RS:1;jenkins-hbase4:40603] zookeeper.ZKUtil(162): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,083 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:26,083 INFO [RS:1;jenkins-hbase4:40603] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:26,094 INFO [RS:1;jenkins-hbase4:40603] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:26,094 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,094 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,094 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,094 INFO [RS:1;jenkins-hbase4:40603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:26,094 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,098 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:26,099 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,100 DEBUG [RS:1;jenkins-hbase4:40603] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:26,105 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,105 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,105 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,109 INFO [RS:0;jenkins-hbase4:34371] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:26,109 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34371,1676714485773-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,117 INFO [RS:1;jenkins-hbase4:40603] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:26,117 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40603,1676714485799-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,123 INFO [RS:0;jenkins-hbase4:34371] regionserver.Replication(203): jenkins-hbase4.apache.org,34371,1676714485773 started 2023-02-18 10:01:26,123 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34371,1676714485773, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34371, sessionid=0x10066e091960001 2023-02-18 10:01:26,123 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:26,123 DEBUG [RS:0;jenkins-hbase4:34371] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,123 DEBUG [RS:0;jenkins-hbase4:34371] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34371,1676714485773' 2023-02-18 10:01:26,123 DEBUG [RS:0;jenkins-hbase4:34371] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:26,124 DEBUG [RS:0;jenkins-hbase4:34371] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:26,125 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:26,125 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:26,125 DEBUG [RS:0;jenkins-hbase4:34371] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:26,125 DEBUG [RS:0;jenkins-hbase4:34371] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34371,1676714485773' 2023-02-18 10:01:26,125 DEBUG [RS:0;jenkins-hbase4:34371] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:26,125 DEBUG [RS:0;jenkins-hbase4:34371] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:26,126 DEBUG [RS:0;jenkins-hbase4:34371] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:26,126 INFO [RS:0;jenkins-hbase4:34371] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:26,126 INFO [RS:0;jenkins-hbase4:34371] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:26,134 INFO [RS:1;jenkins-hbase4:40603] regionserver.Replication(203): jenkins-hbase4.apache.org,40603,1676714485799 started 2023-02-18 10:01:26,134 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40603,1676714485799, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40603, sessionid=0x10066e091960002 2023-02-18 10:01:26,135 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:26,135 DEBUG [RS:1;jenkins-hbase4:40603] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,135 DEBUG [RS:1;jenkins-hbase4:40603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40603,1676714485799' 2023-02-18 10:01:26,135 DEBUG [RS:1;jenkins-hbase4:40603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:26,135 DEBUG [RS:1;jenkins-hbase4:40603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:26,136 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:26,136 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:26,136 DEBUG [RS:1;jenkins-hbase4:40603] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,136 DEBUG [RS:1;jenkins-hbase4:40603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40603,1676714485799' 2023-02-18 10:01:26,136 DEBUG [RS:1;jenkins-hbase4:40603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:26,136 DEBUG [RS:1;jenkins-hbase4:40603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:26,137 DEBUG [RS:1;jenkins-hbase4:40603] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:26,137 INFO [RS:1;jenkins-hbase4:40603] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:26,137 INFO [RS:1;jenkins-hbase4:40603] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:26,156 DEBUG [jenkins-hbase4:44503] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:26,156 DEBUG [jenkins-hbase4:44503] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:26,158 DEBUG [jenkins-hbase4:44503] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:26,158 DEBUG [jenkins-hbase4:44503] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:26,158 DEBUG [jenkins-hbase4:44503] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:26,159 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40603,1676714485799, state=OPENING 2023-02-18 10:01:26,161 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:26,163 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:26,165 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:26,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40603,1676714485799}] 2023-02-18 10:01:26,320 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,321 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:26,322 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:26,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:26,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:26,329 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40603%2C1676714485799.meta, suffix=.meta, logDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,40603,1676714485799, archiveDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/oldWALs, maxLogs=32 2023-02-18 10:01:26,342 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK] 2023-02-18 10:01:26,343 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK] 2023-02-18 10:01:26,345 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,40603,1676714485799/jenkins-hbase4.apache.org%2C40603%2C1676714485799.meta.1676714486329.meta 2023-02-18 10:01:26,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK], DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK]] 2023-02-18 10:01:26,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:26,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:26,345 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:26,346 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:26,346 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:26,346 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:26,346 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:26,346 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:26,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:26,348 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/info 2023-02-18 10:01:26,348 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/info 2023-02-18 10:01:26,348 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:26,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:26,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:26,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:26,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:26,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:26,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:26,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:26,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/table 2023-02-18 10:01:26,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/table 2023-02-18 10:01:26,352 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:26,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:26,353 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740 2023-02-18 10:01:26,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740 2023-02-18 10:01:26,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:26,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:26,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60582139, jitterRate=-0.09725578129291534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:26,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:26,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714486320 2023-02-18 10:01:26,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:26,362 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:26,362 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40603,1676714485799, state=OPEN 2023-02-18 10:01:26,365 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:26,365 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:26,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:26,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40603,1676714485799 in 200 msec 2023-02-18 10:01:26,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:26,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-18 10:01:26,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 423 msec 2023-02-18 10:01:26,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714486370, completionTime=-1 2023-02-18 10:01:26,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:26,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:26,373 DEBUG [hconnection-0x1de5fc9f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:26,374 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:26,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:26,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714546376 2023-02-18 10:01:26,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714606376 2023-02-18 10:01:26,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-18 10:01:26,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44503,1676714485731-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44503,1676714485731-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44503,1676714485731-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44503, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:26,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:26,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:26,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:26,384 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:26,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:26,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:26,386 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,387 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5 empty. 2023-02-18 10:01:26,387 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,387 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:26,397 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:26,398 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f3f503d1d30d8eacb219f862d63de7f5, NAME => 'hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp 2023-02-18 10:01:26,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:26,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f3f503d1d30d8eacb219f862d63de7f5, disabling compactions & flushes 2023-02-18 10:01:26,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. after waiting 0 ms 2023-02-18 10:01:26,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,410 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,410 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f3f503d1d30d8eacb219f862d63de7f5: 2023-02-18 10:01:26,412 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:26,413 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714486413"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714486413"}]},"ts":"1676714486413"} 2023-02-18 10:01:26,416 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:26,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:26,417 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714486417"}]},"ts":"1676714486417"} 2023-02-18 10:01:26,418 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:26,422 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:26,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:26,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:26,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:26,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f3f503d1d30d8eacb219f862d63de7f5, ASSIGN}] 2023-02-18 10:01:26,425 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f3f503d1d30d8eacb219f862d63de7f5, ASSIGN 2023-02-18 10:01:26,426 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f3f503d1d30d8eacb219f862d63de7f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40603,1676714485799; forceNewPlan=false, retain=false 2023-02-18 10:01:26,576 INFO [jenkins-hbase4:44503] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:26,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f3f503d1d30d8eacb219f862d63de7f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714486577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714486577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714486577"}]},"ts":"1676714486577"} 2023-02-18 10:01:26,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f3f503d1d30d8eacb219f862d63de7f5, server=jenkins-hbase4.apache.org,40603,1676714485799}] 2023-02-18 10:01:26,734 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,736 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40603%2C1676714485799, suffix=, logDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,40603,1676714485799, archiveDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/oldWALs, maxLogs=32 2023-02-18 10:01:26,751 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK] 2023-02-18 10:01:26,751 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK] 2023-02-18 10:01:26,753 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,40603,1676714485799/jenkins-hbase4.apache.org%2C40603%2C1676714485799.1676714486737 2023-02-18 10:01:26,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK], DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK]] 2023-02-18 10:01:26,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f3f503d1d30d8eacb219f862d63de7f5, NAME => 'hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:26,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:26,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,754 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,755 INFO [StoreOpener-f3f503d1d30d8eacb219f862d63de7f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,756 DEBUG [StoreOpener-f3f503d1d30d8eacb219f862d63de7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/info 2023-02-18 10:01:26,756 DEBUG [StoreOpener-f3f503d1d30d8eacb219f862d63de7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/info 2023-02-18 10:01:26,756 INFO [StoreOpener-f3f503d1d30d8eacb219f862d63de7f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3f503d1d30d8eacb219f862d63de7f5 columnFamilyName info 2023-02-18 10:01:26,757 INFO [StoreOpener-f3f503d1d30d8eacb219f862d63de7f5-1] regionserver.HStore(310): Store=f3f503d1d30d8eacb219f862d63de7f5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:26,757 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,760 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:26,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:26,762 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f3f503d1d30d8eacb219f862d63de7f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68691021, jitterRate=0.023575976490974426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:26,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f3f503d1d30d8eacb219f862d63de7f5: 2023-02-18 10:01:26,763 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5., pid=6, masterSystemTime=1676714486731 2023-02-18 10:01:26,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,764 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:26,765 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f3f503d1d30d8eacb219f862d63de7f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:26,765 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714486765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714486765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714486765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714486765"}]},"ts":"1676714486765"} 2023-02-18 10:01:26,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:26,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f3f503d1d30d8eacb219f862d63de7f5, server=jenkins-hbase4.apache.org,40603,1676714485799 in 187 msec 2023-02-18 10:01:26,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:26,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f3f503d1d30d8eacb219f862d63de7f5, ASSIGN in 345 msec 2023-02-18 10:01:26,770 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:26,770 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714486770"}]},"ts":"1676714486770"} 2023-02-18 10:01:26,771 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:26,773 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:26,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-18 10:01:26,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:26,786 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:26,786 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:26,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:26,797 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:26,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-18 10:01:26,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:26,819 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:26,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-18 10:01:26,836 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:26,838 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.009sec 2023-02-18 10:01:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44503,1676714485731-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:26,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44503,1676714485731-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:26,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:26,922 DEBUG [Listener at localhost/43885] zookeeper.ReadOnlyZKClient(139): Connect 0x2e2d0306 to 127.0.0.1:55307 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:26,927 DEBUG [Listener at localhost/43885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32e0cc7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:26,928 DEBUG [hconnection-0x2ad26dba-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:26,930 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:26,931 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:26,932 DEBUG [Listener at localhost/43885] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:26,934 DEBUG [Listener at localhost/43885] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:26,935 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:26,936 INFO [Listener at localhost/43885] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:26,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:26,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:26,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:60780 deadline: 1676714546936, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:26,937 INFO [Listener at localhost/43885] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-18 10:01:26,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:26,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:26,941 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:26,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-18 10:01:26,942 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:26,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:26,943 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:26,944 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d empty. 2023-02-18 10:01:26,944 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:26,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-18 10:01:26,954 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:26,956 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9ebe2e4c486c2168b636707d54c1f0d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp 2023-02-18 10:01:26,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:26,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing c9ebe2e4c486c2168b636707d54c1f0d, disabling compactions & flushes 2023-02-18 10:01:26,963 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:26,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:26,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. after waiting 0 ms 2023-02-18 10:01:26,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:26,963 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:26,963 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for c9ebe2e4c486c2168b636707d54c1f0d: 2023-02-18 10:01:26,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:26,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676714486966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714486966"}]},"ts":"1676714486966"} 2023-02-18 10:01:26,967 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:26,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:26,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714486968"}]},"ts":"1676714486968"} 2023-02-18 10:01:26,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-18 10:01:26,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:26,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:26,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:26,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:26,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, ASSIGN}] 2023-02-18 10:01:26,976 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, ASSIGN 2023-02-18 10:01:26,977 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40603,1676714485799; forceNewPlan=false, retain=false 2023-02-18 10:01:27,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:27,127 INFO [jenkins-hbase4:44503] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:27,128 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c9ebe2e4c486c2168b636707d54c1f0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,128 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676714487128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714487128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714487128"}]},"ts":"1676714487128"} 2023-02-18 10:01:27,129 INFO [RS:0;jenkins-hbase4:34371] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34371%2C1676714485773, suffix=, logDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,34371,1676714485773, archiveDir=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/oldWALs, maxLogs=32 2023-02-18 10:01:27,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure c9ebe2e4c486c2168b636707d54c1f0d, server=jenkins-hbase4.apache.org,40603,1676714485799}] 2023-02-18 10:01:27,144 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK] 2023-02-18 10:01:27,145 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK] 2023-02-18 10:01:27,149 INFO [RS:0;jenkins-hbase4:34371] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,34371,1676714485773/jenkins-hbase4.apache.org%2C34371%2C1676714485773.1676714487129 2023-02-18 10:01:27,149 DEBUG [RS:0;jenkins-hbase4:34371] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45127,DS-b52320cd-43e7-4cac-9377-01818c22435b,DISK], DatanodeInfoWithStorage[127.0.0.1:44961,DS-553a95ea-e500-4cbd-b399-b8da9884ea46,DISK]] 2023-02-18 10:01:27,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:27,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:27,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9ebe2e4c486c2168b636707d54c1f0d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:27,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:27,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,287 INFO [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,288 DEBUG [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1 2023-02-18 10:01:27,288 DEBUG [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1 2023-02-18 10:01:27,288 INFO [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9ebe2e4c486c2168b636707d54c1f0d columnFamilyName f1 2023-02-18 10:01:27,289 INFO [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] regionserver.HStore(310): Store=c9ebe2e4c486c2168b636707d54c1f0d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:27,289 INFO [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,290 DEBUG [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2 2023-02-18 10:01:27,290 DEBUG [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2 2023-02-18 10:01:27,290 INFO [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9ebe2e4c486c2168b636707d54c1f0d columnFamilyName f2 2023-02-18 10:01:27,291 INFO [StoreOpener-c9ebe2e4c486c2168b636707d54c1f0d-1] regionserver.HStore(310): Store=c9ebe2e4c486c2168b636707d54c1f0d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:27,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:27,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:27,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:27,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c9ebe2e4c486c2168b636707d54c1f0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67199211, jitterRate=0.0013462752103805542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:27,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c9ebe2e4c486c2168b636707d54c1f0d: 2023-02-18 10:01:27,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d., pid=12, masterSystemTime=1676714487282 2023-02-18 10:01:27,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:27,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:27,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c9ebe2e4c486c2168b636707d54c1f0d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,300 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676714487299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714487299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714487299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714487299"}]},"ts":"1676714487299"} 2023-02-18 10:01:27,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 10:01:27,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure c9ebe2e4c486c2168b636707d54c1f0d, server=jenkins-hbase4.apache.org,40603,1676714485799 in 171 msec 2023-02-18 10:01:27,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 10:01:27,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, ASSIGN in 328 msec 2023-02-18 10:01:27,304 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:27,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714487304"}]},"ts":"1676714487304"} 2023-02-18 10:01:27,306 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-18 10:01:27,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:27,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 369 msec 2023-02-18 10:01:27,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:27,547 INFO [Listener at localhost/43885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-18 10:01:27,547 DEBUG [Listener at localhost/43885] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-18 10:01:27,547 INFO [Listener at localhost/43885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:27,550 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-18 10:01:27,550 INFO [Listener at localhost/43885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:27,550 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-18 10:01:27,550 INFO [Listener at localhost/43885] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:27,604 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40603] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:27,779 INFO [Listener at localhost/43885] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:27,779 INFO [Listener at localhost/43885] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:27,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 10:01:27,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714487780 (current time:1676714487780). 2023-02-18 10:01:27,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:27,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] zookeeper.ReadOnlyZKClient(139): Connect 0x71e85391 to 127.0.0.1:55307 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:27,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7448d0b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:27,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:27,803 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:27,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71e85391 to 127.0.0.1:55307 2023-02-18 10:01:27,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:27,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:27,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 10:01:27,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 10:01:27,809 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 10:01:27,810 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676715087810 2023-02-18 10:01:27,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 10:01:27,813 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:27,815 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 10:01:27,815 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:27,815 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:27,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 10:01:27,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 8 msec 2023-02-18 10:01:27,817 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 10:01:27,818 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676715087818 2023-02-18 10:01:27,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-18 10:01:27,835 INFO [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-18 10:01:27,835 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:27,836 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-18 10:01:27,836 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-18 10:01:27,899 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 10:01:27,909 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 10:01:27,909 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:27,910 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:27,910 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:27,910 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:27,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 10:01:27,911 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,911 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 10:01:27,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 10:01:27,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 10:01:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-18 10:01:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-18 10:01:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:27,915 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-18 10:01:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:27,915 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-18 10:01:27,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 10:01:27,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 10:01:27,915 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 10:01:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 10:01:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:27,917 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 10:01:27,917 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 10:01:27,917 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34371,1676714485773' joining acquired barrier for procedure (foo) in zk 2023-02-18 10:01:27,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 10:01:27,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:27,918 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,921 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 10:01:27,921 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 10:01:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40603,1676714485799' joining acquired barrier for procedure (foo) in zk 2023-02-18 10:01:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:27,923 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,923 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:27,923 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,924 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:27,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40603,1676714485799' joining acquired barrier for procedure 'foo' on coordinator 2023-02-18 10:01:27,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@957a249[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:27,925 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-18 10:01:27,925 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:27,928 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 10:01:27,928 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 10:01:27,928 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 10:01:27,928 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34371,1676714485773' in zk 2023-02-18 10:01:27,928 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,928 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:27,929 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 10:01:27,929 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:27,929 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 10:01:27,932 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 10:01:27,932 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:27,932 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:27,933 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. started... 2023-02-18 10:01:27,933 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HRegion(2744): Flushing c9ebe2e4c486c2168b636707d54c1f0d 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 10:01:27,954 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f1/d2ed820e06a948a39966a50aceca9a36 2023-02-18 10:01:27,974 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f2/dc630e46a31a496bb049ec7678a01589 2023-02-18 10:01:27,979 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f1/d2ed820e06a948a39966a50aceca9a36 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/d2ed820e06a948a39966a50aceca9a36 2023-02-18 10:01:27,982 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/d2ed820e06a948a39966a50aceca9a36, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:27,983 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f2/dc630e46a31a496bb049ec7678a01589 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/dc630e46a31a496bb049ec7678a01589 2023-02-18 10:01:27,987 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/dc630e46a31a496bb049ec7678a01589, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:27,988 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for c9ebe2e4c486c2168b636707d54c1f0d in 55ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:27,988 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for c9ebe2e4c486c2168b636707d54c1f0d: 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.' region-info for snapshot=foo 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/d2ed820e06a948a39966a50aceca9a36] hfiles 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/d2ed820e06a948a39966a50aceca9a36 for snapshot=foo 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/dc630e46a31a496bb049ec7678a01589] hfiles 2023-02-18 10:01:27,989 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/dc630e46a31a496bb049ec7678a01589 for snapshot=foo 2023-02-18 10:01:27,998 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. completed. 2023-02-18 10:01:27,998 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 10:01:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40603,1676714485799' in zk 2023-02-18 10:01:28,000 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,000 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 10:01:28,000 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:28,000 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 10:01:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,40603,1676714485799': 2023-02-18 10:01:28,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40603,1676714485799' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-18 10:01:28,004 INFO [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-18 10:01:28,004 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:28,004 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:28,004 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-18 10:01:28,004 INFO [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:28,005 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,005 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,005 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:28,005 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:28,005 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:28,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:28,006 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:28,006 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,008 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,008 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:28,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:28,015 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:28,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-18 10:01:28,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-18 10:01:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:28,015 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:28,018 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,018 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:28,016 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:28,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:28,018 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,019 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:28,019 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:28,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.hbase-snapshot/.tmp/foo 2023-02-18 10:01:28,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:28,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:28,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-18 10:01:28,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.hbase-snapshot/.tmp/foo to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.hbase-snapshot/foo 2023-02-18 10:01:28,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-18 10:01:28,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.hbase-snapshot/.tmp/foo 2023-02-18 10:01:28,060 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.hbase-snapshot/.tmp/foo 2023-02-18 10:01:28,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676714487813Consolidate snapshot: foo at 1676714488018 (+205 ms)Loading Region manifests for foo at 1676714488018Writing data manifest for foo at 1676714488023 (+5 ms)Verifying snapshot: foo at 1676714488034 (+11 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676714488060 (+26 ms) 2023-02-18 10:01:28,062 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 10:01:28,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 248 msec 2023-02-18 10:01:28,119 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:28,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 10:01:28,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:28,120 INFO [Listener at localhost/43885] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:28,125 INFO [Listener at localhost/43885] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:28,129 INFO [Listener at localhost/43885] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:28,167 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40603] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,254 INFO [Listener at localhost/43885] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:28,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:28,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,262 INFO [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-18 10:01:28,262 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:28,263 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-18 10:01:28,263 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-18 10:01:28,263 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,263 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,264 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:28,264 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:28,265 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:28,265 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,265 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,266 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-18 10:01:28,266 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:28,268 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-18 10:01:28,268 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-18 10:01:28,268 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:28,271 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 10:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:28,272 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,271 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-18 10:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-18 10:01:28,272 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. started... 2023-02-18 10:01:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34371,1676714485773' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-18 10:01:28,272 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c9ebe2e4c486c2168b636707d54c1f0d 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 10:01:28,274 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,274 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,274 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:28,290 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f1/eb5bced076ba46a9b3ee5d0707e977c6 2023-02-18 10:01:28,308 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f2/bb75e75c823547ec8b66c4589b12055a 2023-02-18 10:01:28,313 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f1/eb5bced076ba46a9b3ee5d0707e977c6 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/eb5bced076ba46a9b3ee5d0707e977c6 2023-02-18 10:01:28,317 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/eb5bced076ba46a9b3ee5d0707e977c6, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:28,318 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/.tmp/f2/bb75e75c823547ec8b66c4589b12055a as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/bb75e75c823547ec8b66c4589b12055a 2023-02-18 10:01:28,322 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/bb75e75c823547ec8b66c4589b12055a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:28,323 INFO [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for c9ebe2e4c486c2168b636707d54c1f0d in 51ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:28,324 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c9ebe2e4c486c2168b636707d54c1f0d: 2023-02-18 10:01:28,324 DEBUG [rs(jenkins-hbase4.apache.org,40603,1676714485799)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 10:01:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 10:01:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-18 10:01:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40603,1676714485799' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-18 10:01:28,326 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,326 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:28,327 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,327 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40603,1676714485799' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-18 10:01:28,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6827bb[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:28,328 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-18 10:01:28,328 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-18 10:01:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-18 10:01:28,330 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,330 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-18 10:01:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,40603,1676714485799' in zk 2023-02-18 10:01:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-18 10:01:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34371,1676714485773' in zk 2023-02-18 10:01:28,332 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,332 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-18 10:01:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,332 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:28,332 DEBUG [member: 'jenkins-hbase4.apache.org,40603,1676714485799' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-18 10:01:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:28,333 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-18 10:01:28,333 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:28,333 DEBUG [member: 'jenkins-hbase4.apache.org,34371,1676714485773' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-18 10:01:28,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:28,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:28,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,40603,1676714485799': 2023-02-18 10:01:28,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40603,1676714485799' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-18 10:01:28,337 INFO [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-18 10:01:28,337 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:28,337 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:28,337 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,337 INFO [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:28,338 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:28,339 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:28,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:28,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:28,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,344 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,344 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:28,346 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,346 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,353 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:28,353 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:28,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:28,353 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:28,354 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:28,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:28,354 DEBUG [(jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:28,353 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,353 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:28,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-18 10:01:28,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:28,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:28,355 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:28,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:28,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:28,455 DEBUG [Listener at localhost/43885] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:28,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:28,462 INFO [Listener at localhost/43885] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676714487780 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:28,462 DEBUG [Listener at localhost/43885] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45785/user/jenkins/test-data/135fb61f-0a4b-080e-fa42-0c6b8f3c1ffd/foo/01f0d89a-8b75-4dc3-882f-320b25a06d85/data/default/testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,463 INFO [Listener at localhost/43885] snapshot.RestoreSnapshotHelper(239): region to add: c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:28,463 INFO [Listener at localhost/43885] snapshot.RestoreSnapshotHelper(585): clone region=c9ebe2e4c486c2168b636707d54c1f0d as c9ebe2e4c486c2168b636707d54c1f0d in snapshot foo 2023-02-18 10:01:28,464 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9ebe2e4c486c2168b636707d54c1f0d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45785/user/jenkins/test-data/135fb61f-0a4b-080e-fa42-0c6b8f3c1ffd/foo/01f0d89a-8b75-4dc3-882f-320b25a06d85 2023-02-18 10:01:28,474 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:28,474 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2ed820e06a948a39966a50aceca9a36 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,477 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dc630e46a31a496bb049ec7678a01589 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,482 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c9ebe2e4c486c2168b636707d54c1f0d, disabling compactions & flushes 2023-02-18 10:01:28,482 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,482 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,482 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. after waiting 0 ms 2023-02-18 10:01:28,482 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,482 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,482 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c9ebe2e4c486c2168b636707d54c1f0d: 2023-02-18 10:01:28,483 INFO [Listener at localhost/43885] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676714487780 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:28,483 DEBUG [Listener at localhost/43885] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45785/user/jenkins/test-data/135fb61f-0a4b-080e-fa42-0c6b8f3c1ffd/foo/01f0d89a-8b75-4dc3-882f-320b25a06d85 2023-02-18 10:01:28,483 DEBUG [Listener at localhost/43885] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45785/user/jenkins/test-data/135fb61f-0a4b-080e-fa42-0c6b8f3c1ffd/foo/01f0d89a-8b75-4dc3-882f-320b25a06d85 2023-02-18 10:01:28,483 DEBUG [Listener at localhost/43885] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:28,484 DEBUG [Listener at localhost/43885] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:28,485 DEBUG [Listener at localhost/43885] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-18 10:01:28,485 DEBUG [Listener at localhost/43885] util.CommonFSUtils(699): |----------c9ebe2e4c486c2168b636707d54c1f0d/ 2023-02-18 10:01:28,486 DEBUG [Listener at localhost/43885] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:28,486 DEBUG [Listener at localhost/43885] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:28,487 DEBUG [Listener at localhost/43885] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=c9ebe2e4c486c2168b636707d54c1f0d-d2ed820e06a948a39966a50aceca9a36 2023-02-18 10:01:28,487 DEBUG [Listener at localhost/43885] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:28,487 DEBUG [Listener at localhost/43885] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=c9ebe2e4c486c2168b636707d54c1f0d-dc630e46a31a496bb049ec7678a01589 2023-02-18 10:01:28,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-18 10:01:28,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-18 10:01:28,493 INFO [Listener at localhost/43885] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:28,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714488499"}]},"ts":"1676714488499"} 2023-02-18 10:01:28,501 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-18 10:01:28,504 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-18 10:01:28,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, UNASSIGN}] 2023-02-18 10:01:28,507 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, UNASSIGN 2023-02-18 10:01:28,508 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c9ebe2e4c486c2168b636707d54c1f0d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,508 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676714488508"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714488508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714488508"}]},"ts":"1676714488508"} 2023-02-18 10:01:28,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure c9ebe2e4c486c2168b636707d54c1f0d, server=jenkins-hbase4.apache.org,40603,1676714485799}] 2023-02-18 10:01:28,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:28,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:28,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c9ebe2e4c486c2168b636707d54c1f0d, disabling compactions & flushes 2023-02-18 10:01:28,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. after waiting 0 ms 2023-02-18 10:01:28,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:28,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d. 2023-02-18 10:01:28,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c9ebe2e4c486c2168b636707d54c1f0d: 2023-02-18 10:01:28,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:28,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c9ebe2e4c486c2168b636707d54c1f0d, regionState=CLOSED 2023-02-18 10:01:28,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676714488670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714488670"}]},"ts":"1676714488670"} 2023-02-18 10:01:28,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 10:01:28,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure c9ebe2e4c486c2168b636707d54c1f0d, server=jenkins-hbase4.apache.org,40603,1676714485799 in 161 msec 2023-02-18 10:01:28,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 10:01:28,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=c9ebe2e4c486c2168b636707d54c1f0d, UNASSIGN in 169 msec 2023-02-18 10:01:28,675 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714488675"}]},"ts":"1676714488675"} 2023-02-18 10:01:28,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-18 10:01:28,678 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-18 10:01:28,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 184 msec 2023-02-18 10:01:28,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:28,803 INFO [Listener at localhost/43885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-18 10:01:28,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,806 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,806 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:28,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:28,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1, FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2, FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/recovered.edits] 2023-02-18 10:01:28,815 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/d2ed820e06a948a39966a50aceca9a36 to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/archive/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/d2ed820e06a948a39966a50aceca9a36 2023-02-18 10:01:28,816 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/eb5bced076ba46a9b3ee5d0707e977c6 to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/archive/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f1/eb5bced076ba46a9b3ee5d0707e977c6 2023-02-18 10:01:28,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/bb75e75c823547ec8b66c4589b12055a to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/archive/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/bb75e75c823547ec8b66c4589b12055a 2023-02-18 10:01:28,820 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/dc630e46a31a496bb049ec7678a01589 to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/archive/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/f2/dc630e46a31a496bb049ec7678a01589 2023-02-18 10:01:28,822 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/recovered.edits/12.seqid to hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/archive/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d/recovered.edits/12.seqid 2023-02-18 10:01:28,823 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/c9ebe2e4c486c2168b636707d54c1f0d 2023-02-18 10:01:28,823 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-18 10:01:28,825 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,826 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-18 10:01:28,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-18 10:01:28,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-18 10:01:28,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714488829"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:28,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 10:01:28,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c9ebe2e4c486c2168b636707d54c1f0d, NAME => 'testInitTableSnapshotMapperJobConfig,,1676714486938.c9ebe2e4c486c2168b636707d54c1f0d.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 10:01:28,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-18 10:01:28,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676714488831"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:28,834 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-18 10:01:28,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 10:01:28,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-18 10:01:28,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44503] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:28,908 INFO [Listener at localhost/43885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-18 10:01:28,909 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:28,909 INFO [Listener at localhost/43885] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:28,909 DEBUG [Listener at localhost/43885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e2d0306 to 127.0.0.1:55307 2023-02-18 10:01:28,909 DEBUG [Listener at localhost/43885] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:28,909 DEBUG [Listener at localhost/43885] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:28,909 DEBUG [Listener at localhost/43885] util.JVMClusterUtil(257): Found active master hash=1462028786, stopped=false 2023-02-18 10:01:28,909 INFO [Listener at localhost/43885] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:28,911 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:28,911 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:28,912 INFO [Listener at localhost/43885] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:28,911 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:28,912 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:28,914 DEBUG [Listener at localhost/43885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4aac19c1 to 127.0.0.1:55307 2023-02-18 10:01:28,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:28,914 DEBUG [Listener at localhost/43885] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:28,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:28,914 INFO [Listener at localhost/43885] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34371,1676714485773' ***** 2023-02-18 10:01:28,914 INFO [Listener at localhost/43885] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:28,914 INFO [Listener at localhost/43885] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40603,1676714485799' ***** 2023-02-18 10:01:28,914 INFO [Listener at localhost/43885] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:28,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:28,917 INFO [RS:0;jenkins-hbase4:34371] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:28,917 INFO [RS:0;jenkins-hbase4:34371] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:28,917 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:28,917 INFO [RS:0;jenkins-hbase4:34371] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:28,917 INFO [RS:1;jenkins-hbase4:40603] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:28,917 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:28,918 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:28,918 DEBUG [RS:0;jenkins-hbase4:34371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc38f77 to 127.0.0.1:55307 2023-02-18 10:01:28,918 INFO [RS:1;jenkins-hbase4:40603] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:28,918 DEBUG [RS:0;jenkins-hbase4:34371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:28,918 INFO [RS:1;jenkins-hbase4:40603] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:28,918 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34371,1676714485773; all regions closed. 2023-02-18 10:01:28,918 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(3304): Received CLOSE for f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:28,919 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:28,919 DEBUG [RS:1;jenkins-hbase4:40603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x544df045 to 127.0.0.1:55307 2023-02-18 10:01:28,919 DEBUG [RS:1;jenkins-hbase4:40603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:28,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f3f503d1d30d8eacb219f862d63de7f5, disabling compactions & flushes 2023-02-18 10:01:28,919 INFO [RS:1;jenkins-hbase4:40603] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:28,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:28,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:28,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. after waiting 0 ms 2023-02-18 10:01:28,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:28,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing f3f503d1d30d8eacb219f862d63de7f5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:28,919 INFO [RS:1;jenkins-hbase4:40603] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:28,920 INFO [RS:1;jenkins-hbase4:40603] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:28,920 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:28,924 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 10:01:28,924 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1479): Online Regions={f3f503d1d30d8eacb219f862d63de7f5=hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5., 1588230740=hbase:meta,,1.1588230740} 2023-02-18 10:01:28,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:28,925 DEBUG [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1505): Waiting on 1588230740, f3f503d1d30d8eacb219f862d63de7f5 2023-02-18 10:01:28,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:28,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:28,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:28,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:28,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-18 10:01:28,927 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/WALs/jenkins-hbase4.apache.org,34371,1676714485773/jenkins-hbase4.apache.org%2C34371%2C1676714485773.1676714487129 not finished, retry = 0 2023-02-18 10:01:28,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/.tmp/info/2a7be38e051343c6aa2d23a856857444 2023-02-18 10:01:28,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/.tmp/info/2a7be38e051343c6aa2d23a856857444 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/info/2a7be38e051343c6aa2d23a856857444 2023-02-18 10:01:28,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/.tmp/info/4ae960a36fd84803a76d01d11a007935 2023-02-18 10:01:28,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ae960a36fd84803a76d01d11a007935 2023-02-18 10:01:28,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/info/2a7be38e051343c6aa2d23a856857444, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:28,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f3f503d1d30d8eacb219f862d63de7f5 in 36ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:28,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/namespace/f3f503d1d30d8eacb219f862d63de7f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:28,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:28,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f3f503d1d30d8eacb219f862d63de7f5: 2023-02-18 10:01:28,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714486383.f3f503d1d30d8eacb219f862d63de7f5. 2023-02-18 10:01:28,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/.tmp/rep_barrier/b31bf31f7749479bb26462fe6f5d9208 2023-02-18 10:01:28,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b31bf31f7749479bb26462fe6f5d9208 2023-02-18 10:01:28,974 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/.tmp/table/d0da6a4c2f9f4238be931b59db4e5174 2023-02-18 10:01:28,978 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0da6a4c2f9f4238be931b59db4e5174 2023-02-18 10:01:28,978 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/.tmp/info/4ae960a36fd84803a76d01d11a007935 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/info/4ae960a36fd84803a76d01d11a007935 2023-02-18 10:01:28,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ae960a36fd84803a76d01d11a007935 2023-02-18 10:01:28,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/info/4ae960a36fd84803a76d01d11a007935, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 10:01:28,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/.tmp/rep_barrier/b31bf31f7749479bb26462fe6f5d9208 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/rep_barrier/b31bf31f7749479bb26462fe6f5d9208 2023-02-18 10:01:28,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b31bf31f7749479bb26462fe6f5d9208 2023-02-18 10:01:28,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/rep_barrier/b31bf31f7749479bb26462fe6f5d9208, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 10:01:28,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/.tmp/table/d0da6a4c2f9f4238be931b59db4e5174 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/table/d0da6a4c2f9f4238be931b59db4e5174 2023-02-18 10:01:28,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0da6a4c2f9f4238be931b59db4e5174 2023-02-18 10:01:28,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/table/d0da6a4c2f9f4238be931b59db4e5174, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 10:01:28,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=21, compaction requested=false 2023-02-18 10:01:28,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 10:01:28,998 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:28,999 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:28,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:28,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:28,999 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:29,007 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:29,030 DEBUG [RS:0;jenkins-hbase4:34371] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/oldWALs 2023-02-18 10:01:29,030 INFO [RS:0;jenkins-hbase4:34371] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34371%2C1676714485773:(num 1676714487129) 2023-02-18 10:01:29,030 DEBUG [RS:0;jenkins-hbase4:34371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:29,030 INFO [RS:0;jenkins-hbase4:34371] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:29,030 INFO [RS:0;jenkins-hbase4:34371] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:29,030 INFO [RS:0;jenkins-hbase4:34371] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:29,030 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:29,030 INFO [RS:0;jenkins-hbase4:34371] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:29,030 INFO [RS:0;jenkins-hbase4:34371] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:29,031 INFO [RS:0;jenkins-hbase4:34371] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34371 2023-02-18 10:01:29,032 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:29,032 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:29,033 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:29,033 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7903ecc rejected from java.util.concurrent.ThreadPoolExecutor@3afbae6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,033 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34371,1676714485773 2023-02-18 10:01:29,033 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:29,034 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34371,1676714485773] 2023-02-18 10:01:29,034 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34371,1676714485773; numProcessing=1 2023-02-18 10:01:29,036 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34371,1676714485773 already deleted, retry=false 2023-02-18 10:01:29,036 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34371,1676714485773 expired; onlineServers=1 2023-02-18 10:01:29,105 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 10:01:29,105 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 10:01:29,125 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40603,1676714485799; all regions closed. 2023-02-18 10:01:29,130 DEBUG [RS:1;jenkins-hbase4:40603] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/oldWALs 2023-02-18 10:01:29,130 INFO [RS:1;jenkins-hbase4:40603] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40603%2C1676714485799.meta:.meta(num 1676714486329) 2023-02-18 10:01:29,135 DEBUG [RS:1;jenkins-hbase4:40603] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/oldWALs 2023-02-18 10:01:29,135 INFO [RS:1;jenkins-hbase4:40603] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40603%2C1676714485799:(num 1676714486737) 2023-02-18 10:01:29,135 DEBUG [RS:1;jenkins-hbase4:40603] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:29,135 INFO [RS:1;jenkins-hbase4:40603] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:29,135 INFO [RS:1;jenkins-hbase4:40603] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:29,135 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:29,136 INFO [RS:1;jenkins-hbase4:40603] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40603 2023-02-18 10:01:29,139 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40603,1676714485799 2023-02-18 10:01:29,139 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:29,139 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@177f42f4 rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,141 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40603,1676714485799] 2023-02-18 10:01:29,141 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40603,1676714485799; numProcessing=2 2023-02-18 10:01:29,143 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40603,1676714485799 already deleted, retry=false 2023-02-18 10:01:29,143 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40603,1676714485799 expired; onlineServers=0 2023-02-18 10:01:29,143 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44503,1676714485731' ***** 2023-02-18 10:01:29,143 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:29,143 DEBUG [M:0;jenkins-hbase4:44503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@531b47ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:29,143 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44503,1676714485731 2023-02-18 10:01:29,143 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44503,1676714485731; all regions closed. 2023-02-18 10:01:29,143 DEBUG [M:0;jenkins-hbase4:44503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:29,143 DEBUG [M:0;jenkins-hbase4:44503] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:29,143 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:29,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714485952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714485952,5,FailOnTimeoutGroup] 2023-02-18 10:01:29,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714485952] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714485952,5,FailOnTimeoutGroup] 2023-02-18 10:01:29,144 DEBUG [M:0;jenkins-hbase4:44503] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:29,145 INFO [M:0;jenkins-hbase4:44503] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:29,145 INFO [M:0;jenkins-hbase4:44503] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:29,145 INFO [M:0;jenkins-hbase4:44503] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:29,145 DEBUG [M:0;jenkins-hbase4:44503] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:29,145 INFO [M:0;jenkins-hbase4:44503] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:29,146 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:29,146 ERROR [M:0;jenkins-hbase4:44503] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-02-18 10:01:29,146 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 10:01:29,146 INFO [M:0;jenkins-hbase4:44503] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:29,146 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:29,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:29,146 DEBUG [M:0;jenkins-hbase4:44503] zookeeper.ZKUtil(398): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:29,146 WARN [M:0;jenkins-hbase4:44503] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:29,146 INFO [M:0;jenkins-hbase4:44503] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:29,147 INFO [M:0;jenkins-hbase4:44503] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:29,147 DEBUG [M:0;jenkins-hbase4:44503] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:29,147 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:29,147 DEBUG [M:0;jenkins-hbase4:44503] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:29,147 DEBUG [M:0;jenkins-hbase4:44503] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:29,147 DEBUG [M:0;jenkins-hbase4:44503] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:29,147 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.88 KB 2023-02-18 10:01:29,157 INFO [M:0;jenkins-hbase4:44503] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b946ac98690246e893b836c72d2da304 2023-02-18 10:01:29,161 DEBUG [M:0;jenkins-hbase4:44503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b946ac98690246e893b836c72d2da304 as hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b946ac98690246e893b836c72d2da304 2023-02-18 10:01:29,165 INFO [M:0;jenkins-hbase4:44503] regionserver.HStore(1080): Added hdfs://localhost:45785/user/jenkins/test-data/cff7d587-a5f7-bf82-1655-ea566071003a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b946ac98690246e893b836c72d2da304, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 10:01:29,165 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57251, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-18 10:01:29,166 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:29,166 DEBUG [M:0;jenkins-hbase4:44503] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:29,170 INFO [M:0;jenkins-hbase4:44503] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:29,170 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:29,170 INFO [M:0;jenkins-hbase4:44503] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44503 2023-02-18 10:01:29,173 DEBUG [M:0;jenkins-hbase4:44503] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44503,1676714485731 already deleted, retry=false 2023-02-18 10:01:29,412 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:29,412 INFO [M:0;jenkins-hbase4:44503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44503,1676714485731; zookeeper connection closed. 2023-02-18 10:01:29,412 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7429b1c5 rejected from java.util.concurrent.ThreadPoolExecutor@70162b98[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,413 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): master:44503-0x10066e091960000, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:29,413 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3df544b4 rejected from java.util.concurrent.ThreadPoolExecutor@70162b98[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,513 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:29,513 INFO [RS:1;jenkins-hbase4:40603] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40603,1676714485799; zookeeper connection closed. 2023-02-18 10:01:29,513 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@adb3093 rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,513 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:40603-0x10066e091960002, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:29,513 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4032fb7c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4032fb7c 2023-02-18 10:01:29,513 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72ad9d2a rejected from java.util.concurrent.ThreadPoolExecutor@1340d4c3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,612 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:29,612 INFO [RS:0;jenkins-hbase4:34371] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34371,1676714485773; zookeeper connection closed. 2023-02-18 10:01:29,613 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@714186d5 rejected from java.util.concurrent.ThreadPoolExecutor@3afbae6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,613 DEBUG [Listener at localhost/43885-EventThread] zookeeper.ZKWatcher(600): regionserver:34371-0x10066e091960001, quorum=127.0.0.1:55307, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:29,613 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@26343f81] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@26343f81 2023-02-18 10:01:29,613 ERROR [Listener at localhost/43885-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@9a75cf7 rejected from java.util.concurrent.ThreadPoolExecutor@3afbae6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:29,613 INFO [Listener at localhost/43885] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:29,613 WARN [Listener at localhost/43885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:29,617 INFO [Listener at localhost/43885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:29,723 WARN [BP-337774314-172.31.14.131-1676714485117 heartbeating to localhost/127.0.0.1:45785] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:29,723 WARN [BP-337774314-172.31.14.131-1676714485117 heartbeating to localhost/127.0.0.1:45785] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337774314-172.31.14.131-1676714485117 (Datanode Uuid 0cc62f6a-a66a-48e0-8345-cccccc16fdf2) service to localhost/127.0.0.1:45785 2023-02-18 10:01:29,724 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/dfs/data/data3/current/BP-337774314-172.31.14.131-1676714485117] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:29,724 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/dfs/data/data4/current/BP-337774314-172.31.14.131-1676714485117] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:29,725 WARN [Listener at localhost/43885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:29,729 INFO [Listener at localhost/43885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:29,832 WARN [BP-337774314-172.31.14.131-1676714485117 heartbeating to localhost/127.0.0.1:45785] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:29,832 WARN [BP-337774314-172.31.14.131-1676714485117 heartbeating to localhost/127.0.0.1:45785] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337774314-172.31.14.131-1676714485117 (Datanode Uuid e9f75d2d-706e-4bb6-b4d5-0a350df8e946) service to localhost/127.0.0.1:45785 2023-02-18 10:01:29,834 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/dfs/data/data1/current/BP-337774314-172.31.14.131-1676714485117] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:29,834 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/cluster_74c7e037-2e38-7bb3-f522-085a35863bc8/dfs/data/data2/current/BP-337774314-172.31.14.131-1676714485117] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:29,864 INFO [Listener at localhost/43885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:29,880 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:29,977 INFO [Listener at localhost/43885] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:29,991 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:30,006 INFO [Listener at localhost/43885] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=176 (was 155) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45785 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/43885 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45785 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44503,1676714485731)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45785 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:45785 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:45785 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 534) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 265), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=8811 (was 8879) 2023-02-18 10:01:30,019 INFO [Listener at localhost/43885] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=176, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=172, AvailableMemoryMB=8810 2023-02-18 10:01:30,032 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/hadoop.log.dir so I do NOT create it in target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e 2023-02-18 10:01:30,033 WARN [Listener at localhost/43885] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 10:01:30,033 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/hadoop.tmp.dir so I do NOT create it in target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e 2023-02-18 10:01:30,033 WARN [Listener at localhost/43885] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8a40d76b-699d-5434-40e8-fd446ae965d6/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 10:01:30,033 DEBUG [Listener at localhost/43885] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e 2023-02-18 10:01:30,033 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:01:30,033 INFO [Listener at localhost/43885] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba, deleteOnExit=true 2023-02-18 10:01:30,033 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:01:30,033 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/test.cache.data in system properties and HBase conf 2023-02-18 10:01:30,034 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:01:30,034 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:01:30,034 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:01:30,034 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:01:30,034 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:01:30,034 DEBUG [Listener at localhost/43885] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:01:30,035 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:30,036 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:30,036 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:01:30,036 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:01:30,036 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:01:30,036 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:30,037 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:01:30,037 INFO [Listener at localhost/43885] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:01:30,041 WARN [Listener at localhost/43885] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:30,042 WARN [Listener at localhost/43885] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:30,084 WARN [Listener at localhost/43885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:30,087 INFO [Listener at localhost/43885] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:30,096 INFO [Listener at localhost/43885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/java.io.tmpdir/Jetty_localhost_43011_hdfs____hteivv/webapp 2023-02-18 10:01:30,199 INFO [Listener at localhost/43885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43011 2023-02-18 10:01:30,204 WARN [Listener at localhost/43885] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:30,204 WARN [Listener at localhost/43885] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:30,243 WARN [Listener at localhost/44109] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:30,253 WARN [Listener at localhost/44109] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:30,255 WARN [Listener at localhost/44109] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:30,256 INFO [Listener at localhost/44109] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:30,263 INFO [Listener at localhost/44109] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/java.io.tmpdir/Jetty_localhost_35359_datanode____8w5b6k/webapp 2023-02-18 10:01:30,372 INFO [Listener at localhost/44109] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35359 2023-02-18 10:01:30,379 WARN [Listener at localhost/44197] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:30,434 WARN [Listener at localhost/44197] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:30,444 WARN [Listener at localhost/44197] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:30,445 INFO [Listener at localhost/44197] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:30,452 INFO [Listener at localhost/44197] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/java.io.tmpdir/Jetty_localhost_42217_datanode____3sfnup/webapp 2023-02-18 10:01:30,538 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48e23df6b6b52190: Processing first storage report for DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb from datanode ff54ade0-579c-4b09-9904-e7fc65c3c984 2023-02-18 10:01:30,538 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48e23df6b6b52190: from storage DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb node DatanodeRegistration(127.0.0.1:37391, datanodeUuid=ff54ade0-579c-4b09-9904-e7fc65c3c984, infoPort=43727, infoSecurePort=0, ipcPort=44197, storageInfo=lv=-57;cid=testClusterID;nsid=270397430;c=1676714490044), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:30,538 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48e23df6b6b52190: Processing first storage report for DS-ed411770-eefe-4c97-a6e0-e2cdeb301246 from datanode ff54ade0-579c-4b09-9904-e7fc65c3c984 2023-02-18 10:01:30,538 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48e23df6b6b52190: from storage DS-ed411770-eefe-4c97-a6e0-e2cdeb301246 node DatanodeRegistration(127.0.0.1:37391, datanodeUuid=ff54ade0-579c-4b09-9904-e7fc65c3c984, infoPort=43727, infoSecurePort=0, ipcPort=44197, storageInfo=lv=-57;cid=testClusterID;nsid=270397430;c=1676714490044), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:30,574 INFO [Listener at localhost/44197] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42217 2023-02-18 10:01:30,588 WARN [Listener at localhost/33455] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:30,704 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dfffae027c06c5c: Processing first storage report for DS-591bd541-6362-4965-9119-bd462b672514 from datanode 8ec2fec5-c038-4002-9b28-339de15aba0a 2023-02-18 10:01:30,704 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dfffae027c06c5c: from storage DS-591bd541-6362-4965-9119-bd462b672514 node DatanodeRegistration(127.0.0.1:35819, datanodeUuid=8ec2fec5-c038-4002-9b28-339de15aba0a, infoPort=41137, infoSecurePort=0, ipcPort=33455, storageInfo=lv=-57;cid=testClusterID;nsid=270397430;c=1676714490044), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:30,704 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dfffae027c06c5c: Processing first storage report for DS-8d59adba-5e20-4d93-8a09-744a0e5c1181 from datanode 8ec2fec5-c038-4002-9b28-339de15aba0a 2023-02-18 10:01:30,704 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dfffae027c06c5c: from storage DS-8d59adba-5e20-4d93-8a09-744a0e5c1181 node DatanodeRegistration(127.0.0.1:35819, datanodeUuid=8ec2fec5-c038-4002-9b28-339de15aba0a, infoPort=41137, infoSecurePort=0, ipcPort=33455, storageInfo=lv=-57;cid=testClusterID;nsid=270397430;c=1676714490044), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:30,726 DEBUG [Listener at localhost/33455] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e 2023-02-18 10:01:30,728 INFO [Listener at localhost/33455] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/zookeeper_0, clientPort=53471, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:01:30,729 INFO [Listener at localhost/33455] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53471 2023-02-18 10:01:30,729 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,730 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,750 INFO [Listener at localhost/33455] util.FSUtils(479): Created version file at hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa with version=8 2023-02-18 10:01:30,751 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,752 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,754 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/hbase-staging 2023-02-18 10:01:30,755 INFO [Listener at localhost/33455] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:30,756 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,756 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,756 INFO [Listener at localhost/33455] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:30,756 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,756 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:30,756 INFO [Listener at localhost/33455] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:30,757 INFO [Listener at localhost/33455] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45185 2023-02-18 10:01:30,758 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,759 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,761 INFO [Listener at localhost/33455] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45185 connecting to ZooKeeper ensemble=127.0.0.1:53471 2023-02-18 10:01:30,777 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:451850x0, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:30,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45185-0x10066e0a52c0000 connected 2023-02-18 10:01:30,816 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:30,817 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:30,817 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:30,818 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45185 2023-02-18 10:01:30,818 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45185 2023-02-18 10:01:30,819 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45185 2023-02-18 10:01:30,819 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45185 2023-02-18 10:01:30,819 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45185 2023-02-18 10:01:30,820 INFO [Listener at localhost/33455] master.HMaster(444): hbase.rootdir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa, hbase.cluster.distributed=false 2023-02-18 10:01:30,841 INFO [Listener at localhost/33455] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:30,842 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,842 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,842 INFO [Listener at localhost/33455] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:30,842 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,842 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:30,842 INFO [Listener at localhost/33455] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:30,845 INFO [Listener at localhost/33455] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33661 2023-02-18 10:01:30,846 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:30,848 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:30,849 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,850 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,851 INFO [Listener at localhost/33455] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33661 connecting to ZooKeeper ensemble=127.0.0.1:53471 2023-02-18 10:01:30,855 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:336610x0, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:30,857 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): regionserver:336610x0, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:30,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33661-0x10066e0a52c0001 connected 2023-02-18 10:01:30,858 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:30,858 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:30,860 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33661 2023-02-18 10:01:30,860 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33661 2023-02-18 10:01:30,862 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33661 2023-02-18 10:01:30,863 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33661 2023-02-18 10:01:30,864 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33661 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:30,875 INFO [Listener at localhost/33455] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:30,876 INFO [Listener at localhost/33455] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42779 2023-02-18 10:01:30,876 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:30,877 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:30,878 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,878 INFO [Listener at localhost/33455] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,879 INFO [Listener at localhost/33455] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42779 connecting to ZooKeeper ensemble=127.0.0.1:53471 2023-02-18 10:01:30,882 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:427790x0, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:30,883 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): regionserver:427790x0, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:30,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42779-0x10066e0a52c0002 connected 2023-02-18 10:01:30,884 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:30,884 DEBUG [Listener at localhost/33455] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:30,884 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42779 2023-02-18 10:01:30,884 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42779 2023-02-18 10:01:30,885 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42779 2023-02-18 10:01:30,885 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42779 2023-02-18 10:01:30,885 DEBUG [Listener at localhost/33455] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42779 2023-02-18 10:01:30,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:30,887 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:30,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:30,889 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:30,889 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:30,889 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:30,889 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:30,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:30,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45185,1676714490755 from backup master directory 2023-02-18 10:01:30,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:30,893 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:30,893 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:30,893 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:30,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:30,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/hbase.id with ID: 1b46bfd6-1dc2-47cd-be24-d8c4719340ac 2023-02-18 10:01:30,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:30,921 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:30,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x71f772f0 to 127.0.0.1:53471 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:30,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b684cc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:30,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:30,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:30,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:30,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store-tmp 2023-02-18 10:01:30,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:30,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:30,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:30,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:30,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:30,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:30,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:30,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:30,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/WALs/jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:30,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45185%2C1676714490755, suffix=, logDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/WALs/jenkins-hbase4.apache.org,45185,1676714490755, archiveDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:30,960 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK] 2023-02-18 10:01:30,960 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK] 2023-02-18 10:01:30,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/WALs/jenkins-hbase4.apache.org,45185,1676714490755/jenkins-hbase4.apache.org%2C45185%2C1676714490755.1676714490946 2023-02-18 10:01:30,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK], DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK]] 2023-02-18 10:01:30,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:30,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:30,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:30,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:30,964 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:30,965 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:30,966 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:30,967 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:30,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:30,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:30,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:30,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:30,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63965993, jitterRate=-0.04683242738246918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:30,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:30,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:30,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:30,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:30,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:30,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 10:01:30,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 10:01:30,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:30,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:30,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:30,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:30,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:30,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:30,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:30,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:30,992 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:30,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:30,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:30,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:30,995 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:30,995 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:30,995 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:30,995 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:30,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45185,1676714490755, sessionid=0x10066e0a52c0000, setting cluster-up flag (Was=false) 2023-02-18 10:01:31,000 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:31,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:31,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:31,007 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:31,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:31,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:31,013 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.hbase-snapshot/.tmp 2023-02-18 10:01:31,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:31,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714521021 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:31,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:31,022 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:31,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,022 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:31,023 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:31,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:31,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:31,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:31,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:31,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:31,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714491028,5,FailOnTimeoutGroup] 2023-02-18 10:01:31,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714491028,5,FailOnTimeoutGroup] 2023-02-18 10:01:31,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:31,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,038 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:31,039 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:31,039 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa 2023-02-18 10:01:31,052 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:31,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:31,058 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/info 2023-02-18 10:01:31,059 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:31,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:31,061 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:31,061 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:31,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,062 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:31,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/table 2023-02-18 10:01:31,063 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:31,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,064 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740 2023-02-18 10:01:31,065 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740 2023-02-18 10:01:31,068 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:31,069 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:31,072 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:31,073 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60481720, jitterRate=-0.09875214099884033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:31,073 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:31,073 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:31,073 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:31,073 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:31,073 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:31,073 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:31,074 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:31,074 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:31,075 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:31,075 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:31,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:31,077 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:31,079 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:31,087 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(952): ClusterId : 1b46bfd6-1dc2-47cd-be24-d8c4719340ac 2023-02-18 10:01:31,087 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(952): ClusterId : 1b46bfd6-1dc2-47cd-be24-d8c4719340ac 2023-02-18 10:01:31,087 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:31,087 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:31,090 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:31,090 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:31,090 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:31,090 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:31,093 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:31,095 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:31,096 DEBUG [RS:1;jenkins-hbase4:42779] zookeeper.ReadOnlyZKClient(139): Connect 0x3d8284d0 to 127.0.0.1:53471 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:31,103 DEBUG [RS:0;jenkins-hbase4:33661] zookeeper.ReadOnlyZKClient(139): Connect 0x60296a1f to 127.0.0.1:53471 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:31,110 DEBUG [RS:1;jenkins-hbase4:42779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39bd07b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:31,110 DEBUG [RS:1;jenkins-hbase4:42779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cbf8eeb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:31,112 DEBUG [RS:0;jenkins-hbase4:33661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6eee986a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:31,112 DEBUG [RS:0;jenkins-hbase4:33661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ad1016f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:31,124 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42779 2023-02-18 10:01:31,124 INFO [RS:1;jenkins-hbase4:42779] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:31,124 INFO [RS:1;jenkins-hbase4:42779] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:31,124 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:31,125 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45185,1676714490755 with isa=jenkins-hbase4.apache.org/172.31.14.131:42779, startcode=1676714490874 2023-02-18 10:01:31,125 DEBUG [RS:1;jenkins-hbase4:42779] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:31,127 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33661 2023-02-18 10:01:31,127 INFO [RS:0;jenkins-hbase4:33661] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:31,127 INFO [RS:0;jenkins-hbase4:33661] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:31,127 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:31,128 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45185,1676714490755 with isa=jenkins-hbase4.apache.org/172.31.14.131:33661, startcode=1676714490841 2023-02-18 10:01:31,128 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37783, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:31,128 DEBUG [RS:0;jenkins-hbase4:33661] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:31,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,131 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa 2023-02-18 10:01:31,132 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44109 2023-02-18 10:01:31,132 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:31,134 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:31,135 DEBUG [RS:1;jenkins-hbase4:42779] zookeeper.ZKUtil(162): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,135 WARN [RS:1;jenkins-hbase4:42779] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:31,135 INFO [RS:1;jenkins-hbase4:42779] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:31,135 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,136 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49081, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:31,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,137 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa 2023-02-18 10:01:31,137 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44109 2023-02-18 10:01:31,137 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:31,141 DEBUG [RS:0;jenkins-hbase4:33661] zookeeper.ZKUtil(162): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,141 WARN [RS:0;jenkins-hbase4:33661] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:31,141 INFO [RS:0;jenkins-hbase4:33661] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:31,142 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,146 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33661,1676714490841] 2023-02-18 10:01:31,146 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42779,1676714490874] 2023-02-18 10:01:31,155 DEBUG [RS:0;jenkins-hbase4:33661] zookeeper.ZKUtil(162): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,155 DEBUG [RS:1;jenkins-hbase4:42779] zookeeper.ZKUtil(162): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,156 DEBUG [RS:0;jenkins-hbase4:33661] zookeeper.ZKUtil(162): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,156 DEBUG [RS:1;jenkins-hbase4:42779] zookeeper.ZKUtil(162): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,157 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:31,157 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:31,157 INFO [RS:0;jenkins-hbase4:33661] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:31,157 INFO [RS:1;jenkins-hbase4:42779] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:31,164 INFO [RS:0;jenkins-hbase4:33661] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:31,164 INFO [RS:1;jenkins-hbase4:42779] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:31,164 INFO [RS:0;jenkins-hbase4:33661] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:31,164 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,168 INFO [RS:1;jenkins-hbase4:42779] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:31,168 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,176 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:31,180 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:31,182 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,182 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,183 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,183 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,183 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,183 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:31,184 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:0;jenkins-hbase4:33661] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,184 DEBUG [RS:1;jenkins-hbase4:42779] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:31,200 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,200 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,200 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,260 DEBUG [jenkins-hbase4:45185] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:31,260 DEBUG [jenkins-hbase4:45185] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:31,262 DEBUG [jenkins-hbase4:45185] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:31,262 DEBUG [jenkins-hbase4:45185] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:31,262 DEBUG [jenkins-hbase4:45185] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:31,280 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,280 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,280 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,280 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42779,1676714490874, state=OPENING 2023-02-18 10:01:31,282 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:31,284 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:31,284 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:31,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:31,287 INFO [RS:0;jenkins-hbase4:33661] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:31,287 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33661,1676714490841-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,307 INFO [RS:1;jenkins-hbase4:42779] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:31,308 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42779,1676714490874-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,318 INFO [RS:0;jenkins-hbase4:33661] regionserver.Replication(203): jenkins-hbase4.apache.org,33661,1676714490841 started 2023-02-18 10:01:31,318 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33661,1676714490841, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33661, sessionid=0x10066e0a52c0001 2023-02-18 10:01:31,318 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:31,319 DEBUG [RS:0;jenkins-hbase4:33661] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,319 DEBUG [RS:0;jenkins-hbase4:33661] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33661,1676714490841' 2023-02-18 10:01:31,319 DEBUG [RS:0;jenkins-hbase4:33661] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:31,319 DEBUG [RS:0;jenkins-hbase4:33661] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:31,320 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:31,320 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:31,320 DEBUG [RS:0;jenkins-hbase4:33661] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,320 DEBUG [RS:0;jenkins-hbase4:33661] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33661,1676714490841' 2023-02-18 10:01:31,320 DEBUG [RS:0;jenkins-hbase4:33661] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:31,320 INFO [RS:1;jenkins-hbase4:42779] regionserver.Replication(203): jenkins-hbase4.apache.org,42779,1676714490874 started 2023-02-18 10:01:31,320 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42779,1676714490874, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42779, sessionid=0x10066e0a52c0002 2023-02-18 10:01:31,321 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:31,321 DEBUG [RS:1;jenkins-hbase4:42779] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,321 DEBUG [RS:1;jenkins-hbase4:42779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42779,1676714490874' 2023-02-18 10:01:31,321 DEBUG [RS:1;jenkins-hbase4:42779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:31,321 DEBUG [RS:0;jenkins-hbase4:33661] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:31,321 DEBUG [RS:1;jenkins-hbase4:42779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:31,321 DEBUG [RS:0;jenkins-hbase4:33661] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:31,321 INFO [RS:0;jenkins-hbase4:33661] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:31,321 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:31,322 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:31,321 INFO [RS:0;jenkins-hbase4:33661] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:31,322 DEBUG [RS:1;jenkins-hbase4:42779] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,322 DEBUG [RS:1;jenkins-hbase4:42779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42779,1676714490874' 2023-02-18 10:01:31,322 DEBUG [RS:1;jenkins-hbase4:42779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:31,322 DEBUG [RS:1;jenkins-hbase4:42779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:31,322 DEBUG [RS:1;jenkins-hbase4:42779] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:31,322 INFO [RS:1;jenkins-hbase4:42779] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:31,322 INFO [RS:1;jenkins-hbase4:42779] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:31,453 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:31,453 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:31,455 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:31,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:31,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:31,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42779%2C1676714490874.meta, suffix=.meta, logDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,42779,1676714490874, archiveDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/oldWALs, maxLogs=32 2023-02-18 10:01:31,481 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK] 2023-02-18 10:01:31,481 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK] 2023-02-18 10:01:31,484 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,42779,1676714490874/jenkins-hbase4.apache.org%2C42779%2C1676714490874.meta.1676714491461.meta 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK], DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK]] 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:31,487 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:31,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:31,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:31,489 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/info 2023-02-18 10:01:31,489 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/info 2023-02-18 10:01:31,490 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:31,490 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,490 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:31,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:31,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:31,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:31,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,492 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:31,493 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/table 2023-02-18 10:01:31,493 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/table 2023-02-18 10:01:31,493 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:31,494 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740 2023-02-18 10:01:31,496 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740 2023-02-18 10:01:31,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:31,500 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:31,501 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59344440, jitterRate=-0.1156989336013794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:31,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:31,509 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714491453 2023-02-18 10:01:31,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:31,516 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42779,1676714490874, state=OPEN 2023-02-18 10:01:31,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:31,518 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:31,518 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:31,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:31,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42779,1676714490874 in 233 msec 2023-02-18 10:01:31,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:31,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 445 msec 2023-02-18 10:01:31,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 508 msec 2023-02-18 10:01:31,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714491523, completionTime=-1 2023-02-18 10:01:31,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:31,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:31,527 DEBUG [hconnection-0x540ee27a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:31,529 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714551531 2023-02-18 10:01:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714611531 2023-02-18 10:01:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45185,1676714490755-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45185,1676714490755-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45185,1676714490755-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45185, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:31,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:31,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:31,539 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:31,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:31,541 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:31,543 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,543 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91 empty. 2023-02-18 10:01:31,544 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,544 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:31,561 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:31,572 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6bd00dbd9248f114ac4988758023db91, NAME => 'hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:31,600 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:31,600 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6bd00dbd9248f114ac4988758023db91, disabling compactions & flushes 2023-02-18 10:01:31,600 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,600 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,600 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. after waiting 0 ms 2023-02-18 10:01:31,600 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,601 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,601 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6bd00dbd9248f114ac4988758023db91: 2023-02-18 10:01:31,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:31,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714491604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714491604"}]},"ts":"1676714491604"} 2023-02-18 10:01:31,608 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:31,608 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:31,609 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714491609"}]},"ts":"1676714491609"} 2023-02-18 10:01:31,610 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:31,614 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:31,614 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:31,615 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:31,615 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:31,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6bd00dbd9248f114ac4988758023db91, ASSIGN}] 2023-02-18 10:01:31,621 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6bd00dbd9248f114ac4988758023db91, ASSIGN 2023-02-18 10:01:31,622 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6bd00dbd9248f114ac4988758023db91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33661,1676714490841; forceNewPlan=false, retain=false 2023-02-18 10:01:31,772 INFO [jenkins-hbase4:45185] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:31,773 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6bd00dbd9248f114ac4988758023db91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714491773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714491773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714491773"}]},"ts":"1676714491773"} 2023-02-18 10:01:31,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6bd00dbd9248f114ac4988758023db91, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:31,930 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,931 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:31,932 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:31,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,938 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33661%2C1676714490841, suffix=, logDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,33661,1676714490841, archiveDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/oldWALs, maxLogs=32 2023-02-18 10:01:31,956 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK] 2023-02-18 10:01:31,956 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK] 2023-02-18 10:01:31,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,33661,1676714490841/jenkins-hbase4.apache.org%2C33661%2C1676714490841.1676714491938 2023-02-18 10:01:31,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK], DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK]] 2023-02-18 10:01:31,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6bd00dbd9248f114ac4988758023db91, NAME => 'hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:31,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:31,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,961 INFO [StoreOpener-6bd00dbd9248f114ac4988758023db91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,964 DEBUG [StoreOpener-6bd00dbd9248f114ac4988758023db91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/info 2023-02-18 10:01:31,964 DEBUG [StoreOpener-6bd00dbd9248f114ac4988758023db91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/info 2023-02-18 10:01:31,964 INFO [StoreOpener-6bd00dbd9248f114ac4988758023db91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bd00dbd9248f114ac4988758023db91 columnFamilyName info 2023-02-18 10:01:31,965 INFO [StoreOpener-6bd00dbd9248f114ac4988758023db91-1] regionserver.HStore(310): Store=6bd00dbd9248f114ac4988758023db91/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:31,966 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,966 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:31,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:31,972 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6bd00dbd9248f114ac4988758023db91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75059737, jitterRate=0.1184772402048111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:31,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6bd00dbd9248f114ac4988758023db91: 2023-02-18 10:01:31,975 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91., pid=6, masterSystemTime=1676714491930 2023-02-18 10:01:31,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,980 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:31,981 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6bd00dbd9248f114ac4988758023db91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:31,981 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714491981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714491981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714491981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714491981"}]},"ts":"1676714491981"} 2023-02-18 10:01:31,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:31,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6bd00dbd9248f114ac4988758023db91, server=jenkins-hbase4.apache.org,33661,1676714490841 in 206 msec 2023-02-18 10:01:31,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:31,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6bd00dbd9248f114ac4988758023db91, ASSIGN in 370 msec 2023-02-18 10:01:31,987 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:31,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714491987"}]},"ts":"1676714491987"} 2023-02-18 10:01:31,989 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:31,992 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:31,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 455 msec 2023-02-18 10:01:32,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:32,041 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:32,041 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:32,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:32,044 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43144, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:32,055 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:32,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-18 10:01:32,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:32,074 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:32,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-18 10:01:32,083 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:32,085 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:32,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.192sec 2023-02-18 10:01:32,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:32,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:32,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:32,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45185,1676714490755-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:32,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45185,1676714490755-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:32,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:32,088 DEBUG [Listener at localhost/33455] zookeeper.ReadOnlyZKClient(139): Connect 0x0345809d to 127.0.0.1:53471 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:32,094 DEBUG [Listener at localhost/33455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7299a025, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:32,096 DEBUG [hconnection-0x40c46acb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:32,098 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56008, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:32,105 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:32,105 DEBUG [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:32,108 DEBUG [Listener at localhost/33455] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:32,110 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:32,110 INFO [Listener at localhost/33455] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-18 10:01:32,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-18 10:01:32,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:32,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:44868 deadline: 1676714552111, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-18 10:01:32,112 INFO [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-18 10:01:32,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:32,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:32,118 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:32,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-18 10:01:32,119 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:32,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:32,128 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,129 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,129 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:32,129 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,129 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,129 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 empty. 2023-02-18 10:01:32,129 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 empty. 2023-02-18 10:01:32,130 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,130 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:32,130 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b empty. 2023-02-18 10:01:32,130 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb empty. 2023-02-18 10:01:32,130 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:32,130 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,131 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:32,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,131 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,131 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e empty. 2023-02-18 10:01:32,131 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 empty. 2023-02-18 10:01:32,131 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c empty. 2023-02-18 10:01:32,132 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:32,132 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d empty. 2023-02-18 10:01:32,132 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 empty. 2023-02-18 10:01:32,132 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 empty. 2023-02-18 10:01:32,132 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,133 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,133 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,133 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:32,133 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,136 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,136 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,136 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-18 10:01:32,147 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:32,148 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 12749c25940e67ee9c6ce245df355f25, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,149 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8a75cd8168eb6271eebb583b01391eb5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,149 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => bb03af14e6d4f71cedbf1352904daaa6, NAME => 'testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,155 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,155 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing bb03af14e6d4f71cedbf1352904daaa6, disabling compactions & flushes 2023-02-18 10:01:32,155 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,155 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. after waiting 0 ms 2023-02-18 10:01:32,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,156 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,156 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:32,156 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2679b8d9e9da1364429364a1903545eb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,157 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,157 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 12749c25940e67ee9c6ce245df355f25, disabling compactions & flushes 2023-02-18 10:01:32,157 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:32,157 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:32,157 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. after waiting 0 ms 2023-02-18 10:01:32,157 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:32,157 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:32,157 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:32,158 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0d9ae64f235b670d99a3455fc5d7523b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8a75cd8168eb6271eebb583b01391eb5, disabling compactions & flushes 2023-02-18 10:01:32,159 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. after waiting 0 ms 2023-02-18 10:01:32,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,159 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,159 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:32,159 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 898d85681b70eb3f586fde99e89fc87e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,168 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,168 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 2679b8d9e9da1364429364a1903545eb, disabling compactions & flushes 2023-02-18 10:01:32,168 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,168 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,168 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. after waiting 0 ms 2023-02-18 10:01:32,168 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,168 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,168 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:32,169 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b45c94ec7536709f058e2614dccba48c, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,169 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,169 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 898d85681b70eb3f586fde99e89fc87e, disabling compactions & flushes 2023-02-18 10:01:32,169 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:32,169 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:32,169 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. after waiting 0 ms 2023-02-18 10:01:32,169 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:32,169 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:32,169 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:32,169 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => fdec22565c7839cc2851d97972b77251, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,178 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,178 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b45c94ec7536709f058e2614dccba48c, disabling compactions & flushes 2023-02-18 10:01:32,178 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:32,178 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:32,178 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. after waiting 0 ms 2023-02-18 10:01:32,178 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:32,178 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:32,178 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:32,179 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 87ef94a556e6018271369424f1163fe9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing fdec22565c7839cc2851d97972b77251, disabling compactions & flushes 2023-02-18 10:01:32,179 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:32,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:32,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. after waiting 0 ms 2023-02-18 10:01:32,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:32,179 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:32,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:32,180 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 48c8fe525a719aa3c4c0e490bee0816d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp 2023-02-18 10:01:32,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 48c8fe525a719aa3c4c0e490bee0816d, disabling compactions & flushes 2023-02-18 10:01:32,187 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. after waiting 0 ms 2023-02-18 10:01:32,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,187 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,187 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:32,189 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,189 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 87ef94a556e6018271369424f1163fe9, disabling compactions & flushes 2023-02-18 10:01:32,189 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:32,189 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:32,189 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. after waiting 0 ms 2023-02-18 10:01:32,189 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:32,189 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:32,189 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:32,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:32,324 INFO [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42779%2C1676714490874, suffix=, logDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,42779,1676714490874, archiveDir=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/oldWALs, maxLogs=32 2023-02-18 10:01:32,341 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK] 2023-02-18 10:01:32,341 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK] 2023-02-18 10:01:32,344 INFO [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/WALs/jenkins-hbase4.apache.org,42779,1676714490874/jenkins-hbase4.apache.org%2C42779%2C1676714490874.1676714492325 2023-02-18 10:01:32,344 DEBUG [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37391,DS-a5b76bf3-7e4b-4922-8f5a-e241901c10fb,DISK], DatanodeInfoWithStorage[127.0.0.1:35819,DS-591bd541-6362-4965-9119-bd462b672514,DISK]] 2023-02-18 10:01:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:32,568 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,568 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 0d9ae64f235b670d99a3455fc5d7523b, disabling compactions & flushes 2023-02-18 10:01:32,568 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,568 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,568 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. after waiting 0 ms 2023-02-18 10:01:32,568 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,568 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,568 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:32,586 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,587 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714492587"}]},"ts":"1676714492587"} 2023-02-18 10:01:32,590 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 10:01:32,590 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:32,590 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714492590"}]},"ts":"1676714492590"} 2023-02-18 10:01:32,592 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-18 10:01:32,596 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:32,605 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:32,605 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:32,606 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:32,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, ASSIGN}] 2023-02-18 10:01:32,609 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, ASSIGN 2023-02-18 10:01:32,609 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, ASSIGN 2023-02-18 10:01:32,609 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, ASSIGN 2023-02-18 10:01:32,609 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, ASSIGN 2023-02-18 10:01:32,610 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33661,1676714490841; forceNewPlan=false, retain=false 2023-02-18 10:01:32,610 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33661,1676714490841; forceNewPlan=false, retain=false 2023-02-18 10:01:32,610 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42779,1676714490874; forceNewPlan=false, retain=false 2023-02-18 10:01:32,611 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, ASSIGN 2023-02-18 10:01:32,611 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42779,1676714490874; forceNewPlan=false, retain=false 2023-02-18 10:01:32,611 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, ASSIGN 2023-02-18 10:01:32,611 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, ASSIGN 2023-02-18 10:01:32,611 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, ASSIGN 2023-02-18 10:01:32,612 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33661,1676714490841; forceNewPlan=false, retain=false 2023-02-18 10:01:32,612 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, ASSIGN 2023-02-18 10:01:32,612 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33661,1676714490841; forceNewPlan=false, retain=false 2023-02-18 10:01:32,612 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42779,1676714490874; forceNewPlan=false, retain=false 2023-02-18 10:01:32,612 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42779,1676714490874; forceNewPlan=false, retain=false 2023-02-18 10:01:32,613 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, ASSIGN 2023-02-18 10:01:32,613 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33661,1676714490841; forceNewPlan=false, retain=false 2023-02-18 10:01:32,613 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42779,1676714490874; forceNewPlan=false, retain=false 2023-02-18 10:01:32,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:32,760 INFO [jenkins-hbase4:45185] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 10:01:32,769 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b45c94ec7536709f058e2614dccba48c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,769 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492769"}]},"ts":"1676714492769"} 2023-02-18 10:01:32,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=12749c25940e67ee9c6ce245df355f25, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,769 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492769"}]},"ts":"1676714492769"} 2023-02-18 10:01:32,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d9ae64f235b670d99a3455fc5d7523b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2679b8d9e9da1364429364a1903545eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492770"}]},"ts":"1676714492770"} 2023-02-18 10:01:32,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492770"}]},"ts":"1676714492770"} 2023-02-18 10:01:32,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=48c8fe525a719aa3c4c0e490bee0816d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,770 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714492770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492770"}]},"ts":"1676714492770"} 2023-02-18 10:01:32,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure b45c94ec7536709f058e2614dccba48c, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:32,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 12749c25940e67ee9c6ce245df355f25, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:32,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 0d9ae64f235b670d99a3455fc5d7523b, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:32,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=20, state=RUNNABLE; OpenRegionProcedure 48c8fe525a719aa3c4c0e490bee0816d, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:32,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure 2679b8d9e9da1364429364a1903545eb, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:32,785 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fdec22565c7839cc2851d97972b77251, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,785 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492785"}]},"ts":"1676714492785"} 2023-02-18 10:01:32,786 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=898d85681b70eb3f586fde99e89fc87e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492786"}]},"ts":"1676714492786"} 2023-02-18 10:01:32,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure fdec22565c7839cc2851d97972b77251, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:32,788 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bb03af14e6d4f71cedbf1352904daaa6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,788 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714492788"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492788"}]},"ts":"1676714492788"} 2023-02-18 10:01:32,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 898d85681b70eb3f586fde99e89fc87e, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:32,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure bb03af14e6d4f71cedbf1352904daaa6, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:32,790 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8a75cd8168eb6271eebb583b01391eb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,790 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=87ef94a556e6018271369424f1163fe9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492790"}]},"ts":"1676714492790"} 2023-02-18 10:01:32,790 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714492790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714492790"}]},"ts":"1676714492790"} 2023-02-18 10:01:32,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 8a75cd8168eb6271eebb583b01391eb5, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:32,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 87ef94a556e6018271369424f1163fe9, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:32,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 48c8fe525a719aa3c4c0e490bee0816d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 10:01:32,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,932 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,933 DEBUG [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f1 2023-02-18 10:01:32,933 DEBUG [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f1 2023-02-18 10:01:32,933 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48c8fe525a719aa3c4c0e490bee0816d columnFamilyName f1 2023-02-18 10:01:32,934 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(310): Store=48c8fe525a719aa3c4c0e490bee0816d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,934 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,935 DEBUG [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f2 2023-02-18 10:01:32,935 DEBUG [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f2 2023-02-18 10:01:32,936 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48c8fe525a719aa3c4c0e490bee0816d columnFamilyName f2 2023-02-18 10:01:32,936 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(310): Store=48c8fe525a719aa3c4c0e490bee0816d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:32,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:32,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:32,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 48c8fe525a719aa3c4c0e490bee0816d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74903404, jitterRate=0.11614769697189331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:32,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:32,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d., pid=24, masterSystemTime=1676714492926 2023-02-18 10:01:32,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:32,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2679b8d9e9da1364429364a1903545eb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a75cd8168eb6271eebb583b01391eb5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,945 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=48c8fe525a719aa3c4c0e490bee0816d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,945 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714492945"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714492945"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714492945"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714492945"}]},"ts":"1676714492945"} 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,947 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,948 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=20 2023-02-18 10:01:32,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=20, state=SUCCESS; OpenRegionProcedure 48c8fe525a719aa3c4c0e490bee0816d, server=jenkins-hbase4.apache.org,42779,1676714490874 in 169 msec 2023-02-18 10:01:32,949 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1 2023-02-18 10:01:32,949 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1 2023-02-18 10:01:32,949 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1 2023-02-18 10:01:32,949 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1 2023-02-18 10:01:32,949 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2679b8d9e9da1364429364a1903545eb columnFamilyName f1 2023-02-18 10:01:32,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, ASSIGN in 343 msec 2023-02-18 10:01:32,950 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a75cd8168eb6271eebb583b01391eb5 columnFamilyName f1 2023-02-18 10:01:32,950 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(310): Store=2679b8d9e9da1364429364a1903545eb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,950 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,950 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(310): Store=8a75cd8168eb6271eebb583b01391eb5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,950 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,951 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2 2023-02-18 10:01:32,951 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2 2023-02-18 10:01:32,951 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2 2023-02-18 10:01:32,951 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2679b8d9e9da1364429364a1903545eb columnFamilyName f2 2023-02-18 10:01:32,951 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2 2023-02-18 10:01:32,952 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a75cd8168eb6271eebb583b01391eb5 columnFamilyName f2 2023-02-18 10:01:32,952 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(310): Store=2679b8d9e9da1364429364a1903545eb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,952 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(310): Store=8a75cd8168eb6271eebb583b01391eb5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:32,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:32,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:32,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:32,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2679b8d9e9da1364429364a1903545eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71567814, jitterRate=0.066443532705307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:32,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:32,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb., pid=25, masterSystemTime=1676714492926 2023-02-18 10:01:32,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8a75cd8168eb6271eebb583b01391eb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63251467, jitterRate=-0.05747969448566437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:32,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:32,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5., pid=29, masterSystemTime=1676714492941 2023-02-18 10:01:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:32,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d9ae64f235b670d99a3455fc5d7523b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 10:01:32,960 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2679b8d9e9da1364429364a1903545eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,960 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714492960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714492960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714492960"}]},"ts":"1676714492960"} 2023-02-18 10:01:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:32,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bb03af14e6d4f71cedbf1352904daaa6, NAME => 'testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 10:01:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8a75cd8168eb6271eebb583b01391eb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492961"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714492961"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714492961"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714492961"}]},"ts":"1676714492961"} 2023-02-18 10:01:32,962 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,963 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,963 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1 2023-02-18 10:01:32,963 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1 2023-02-18 10:01:32,963 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d9ae64f235b670d99a3455fc5d7523b columnFamilyName f1 2023-02-18 10:01:32,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-18 10:01:32,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure 2679b8d9e9da1364429364a1903545eb, server=jenkins-hbase4.apache.org,42779,1676714490874 in 184 msec 2023-02-18 10:01:32,964 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(310): Store=0d9ae64f235b670d99a3455fc5d7523b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,964 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,964 DEBUG [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f1 2023-02-18 10:01:32,965 DEBUG [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f1 2023-02-18 10:01:32,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-18 10:01:32,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, ASSIGN in 358 msec 2023-02-18 10:01:32,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 8a75cd8168eb6271eebb583b01391eb5, server=jenkins-hbase4.apache.org,33661,1676714490841 in 171 msec 2023-02-18 10:01:32,965 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb03af14e6d4f71cedbf1352904daaa6 columnFamilyName f1 2023-02-18 10:01:32,965 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(310): Store=bb03af14e6d4f71cedbf1352904daaa6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,965 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,966 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2 2023-02-18 10:01:32,966 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2 2023-02-18 10:01:32,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, ASSIGN in 359 msec 2023-02-18 10:01:32,966 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d9ae64f235b670d99a3455fc5d7523b columnFamilyName f2 2023-02-18 10:01:32,967 DEBUG [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f2 2023-02-18 10:01:32,967 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(310): Store=0d9ae64f235b670d99a3455fc5d7523b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,967 DEBUG [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f2 2023-02-18 10:01:32,967 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb03af14e6d4f71cedbf1352904daaa6 columnFamilyName f2 2023-02-18 10:01:32,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,967 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(310): Store=bb03af14e6d4f71cedbf1352904daaa6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:32,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:32,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:32,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:32,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:32,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d9ae64f235b670d99a3455fc5d7523b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67276895, jitterRate=0.0025038570165634155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:32,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:32,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b., pid=23, masterSystemTime=1676714492926 2023-02-18 10:01:32,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:32,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bb03af14e6d4f71cedbf1352904daaa6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70271799, jitterRate=0.04713140428066254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:32,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:32,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6., pid=28, masterSystemTime=1676714492941 2023-02-18 10:01:32,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:32,975 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d9ae64f235b670d99a3455fc5d7523b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:32,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:32,975 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714492974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714492974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714492974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714492974"}]},"ts":"1676714492974"} 2023-02-18 10:01:32,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b45c94ec7536709f058e2614dccba48c, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 10:01:32,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:32,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:32,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87ef94a556e6018271369424f1163fe9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 10:01:32,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bb03af14e6d4f71cedbf1352904daaa6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:32,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,977 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714492976"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714492976"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714492976"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714492976"}]},"ts":"1676714492976"} 2023-02-18 10:01:32,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:32,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-18 10:01:32,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 0d9ae64f235b670d99a3455fc5d7523b, server=jenkins-hbase4.apache.org,42779,1676714490874 in 200 msec 2023-02-18 10:01:32,978 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, ASSIGN in 372 msec 2023-02-18 10:01:32,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-18 10:01:32,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure bb03af14e6d4f71cedbf1352904daaa6, server=jenkins-hbase4.apache.org,33661,1676714490841 in 189 msec 2023-02-18 10:01:32,980 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1 2023-02-18 10:01:32,980 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1 2023-02-18 10:01:32,980 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ef94a556e6018271369424f1163fe9 columnFamilyName f1 2023-02-18 10:01:32,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, ASSIGN in 373 msec 2023-02-18 10:01:32,980 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(310): Store=87ef94a556e6018271369424f1163fe9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,980 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,981 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2 2023-02-18 10:01:32,981 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2 2023-02-18 10:01:32,982 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ef94a556e6018271369424f1163fe9 columnFamilyName f2 2023-02-18 10:01:32,982 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(310): Store=87ef94a556e6018271369424f1163fe9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,985 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:32,987 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1 2023-02-18 10:01:32,987 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1 2023-02-18 10:01:32,987 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b45c94ec7536709f058e2614dccba48c columnFamilyName f1 2023-02-18 10:01:32,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:32,988 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(310): Store=b45c94ec7536709f058e2614dccba48c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,988 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,989 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2 2023-02-18 10:01:32,989 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2 2023-02-18 10:01:32,990 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b45c94ec7536709f058e2614dccba48c columnFamilyName f2 2023-02-18 10:01:32,994 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(310): Store=b45c94ec7536709f058e2614dccba48c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:32,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87ef94a556e6018271369424f1163fe9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58946883, jitterRate=-0.12162299454212189}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:32,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:33,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9., pid=30, masterSystemTime=1676714492941 2023-02-18 10:01:33,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:33,002 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=87ef94a556e6018271369424f1163fe9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,002 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714493002"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714493002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714493002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714493002"}]},"ts":"1676714493002"} 2023-02-18 10:01:33,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:33,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, ASSIGN in 401 msec 2023-02-18 10:01:33,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:33,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:33,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fdec22565c7839cc2851d97972b77251, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 10:01:33,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:33,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-18 10:01:33,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 87ef94a556e6018271369424f1163fe9, server=jenkins-hbase4.apache.org,33661,1676714490841 in 212 msec 2023-02-18 10:01:33,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:33,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:33,016 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,018 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1 2023-02-18 10:01:33,018 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1 2023-02-18 10:01:33,018 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdec22565c7839cc2851d97972b77251 columnFamilyName f1 2023-02-18 10:01:33,019 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(310): Store=fdec22565c7839cc2851d97972b77251/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:33,019 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,021 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2 2023-02-18 10:01:33,021 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2 2023-02-18 10:01:33,021 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdec22565c7839cc2851d97972b77251 columnFamilyName f2 2023-02-18 10:01:33,022 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(310): Store=fdec22565c7839cc2851d97972b77251/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:33,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b45c94ec7536709f058e2614dccba48c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62568033, jitterRate=-0.06766365468502045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:33,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:33,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c., pid=21, masterSystemTime=1676714492926 2023-02-18 10:01:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:33,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:33,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:33,035 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=b45c94ec7536709f058e2614dccba48c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12749c25940e67ee9c6ce245df355f25, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 10:01:33,035 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714493035"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714493035"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714493035"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714493035"}]},"ts":"1676714493035"} 2023-02-18 10:01:33,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:33,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:33,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-18 10:01:33,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure b45c94ec7536709f058e2614dccba48c, server=jenkins-hbase4.apache.org,42779,1676714490874 in 263 msec 2023-02-18 10:01:33,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, ASSIGN in 434 msec 2023-02-18 10:01:33,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:33,051 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:33,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fdec22565c7839cc2851d97972b77251; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69375675, jitterRate=0.033778116106987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:33,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:33,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251., pid=26, masterSystemTime=1676714492941 2023-02-18 10:01:33,058 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1 2023-02-18 10:01:33,058 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1 2023-02-18 10:01:33,058 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=fdec22565c7839cc2851d97972b77251, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:33,058 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12749c25940e67ee9c6ce245df355f25 columnFamilyName f1 2023-02-18 10:01:33,058 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714493058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714493058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714493058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714493058"}]},"ts":"1676714493058"} 2023-02-18 10:01:33,059 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(310): Store=12749c25940e67ee9c6ce245df355f25/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:33,059 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:33,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:33,061 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2 2023-02-18 10:01:33,062 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2 2023-02-18 10:01:33,062 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12749c25940e67ee9c6ce245df355f25 columnFamilyName f2 2023-02-18 10:01:33,063 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(310): Store=12749c25940e67ee9c6ce245df355f25/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:33,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 898d85681b70eb3f586fde99e89fc87e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 10:01:33,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-18 10:01:33,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:33,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure fdec22565c7839cc2851d97972b77251, server=jenkins-hbase4.apache.org,33661,1676714490841 in 274 msec 2023-02-18 10:01:33,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, ASSIGN in 458 msec 2023-02-18 10:01:33,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:33,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:33,072 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:33,079 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1 2023-02-18 10:01:33,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 12749c25940e67ee9c6ce245df355f25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74351512, jitterRate=0.10792386531829834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:33,079 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1 2023-02-18 10:01:33,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:33,080 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 898d85681b70eb3f586fde99e89fc87e columnFamilyName f1 2023-02-18 10:01:33,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25., pid=22, masterSystemTime=1676714492926 2023-02-18 10:01:33,081 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(310): Store=898d85681b70eb3f586fde99e89fc87e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:33,081 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:33,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:33,082 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=12749c25940e67ee9c6ce245df355f25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,082 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714493082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714493082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714493082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714493082"}]},"ts":"1676714493082"} 2023-02-18 10:01:33,085 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2 2023-02-18 10:01:33,085 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2 2023-02-18 10:01:33,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-18 10:01:33,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 12749c25940e67ee9c6ce245df355f25, server=jenkins-hbase4.apache.org,42779,1676714490874 in 309 msec 2023-02-18 10:01:33,085 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 898d85681b70eb3f586fde99e89fc87e columnFamilyName f2 2023-02-18 10:01:33,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, ASSIGN in 479 msec 2023-02-18 10:01:33,086 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(310): Store=898d85681b70eb3f586fde99e89fc87e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:33,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:33,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:33,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:33,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 898d85681b70eb3f586fde99e89fc87e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74274115, jitterRate=0.10677056014537811}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:33,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:33,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e., pid=27, masterSystemTime=1676714492941 2023-02-18 10:01:33,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:33,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:33,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=898d85681b70eb3f586fde99e89fc87e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714493094"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714493094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714493094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714493094"}]},"ts":"1676714493094"} 2023-02-18 10:01:33,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-18 10:01:33,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 898d85681b70eb3f586fde99e89fc87e, server=jenkins-hbase4.apache.org,33661,1676714490841 in 307 msec 2023-02-18 10:01:33,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-18 10:01:33,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, ASSIGN in 491 msec 2023-02-18 10:01:33,099 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:33,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714493099"}]},"ts":"1676714493099"} 2023-02-18 10:01:33,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-18 10:01:33,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:33,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 989 msec 2023-02-18 10:01:33,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:33,226 INFO [Listener at localhost/33455] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-18 10:01:33,226 DEBUG [Listener at localhost/33455] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-18 10:01:33,227 INFO [Listener at localhost/33455] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:33,229 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-18 10:01:33,230 INFO [Listener at localhost/33455] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:33,230 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-18 10:01:33,230 INFO [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:33,263 DEBUG [hconnection-0x40c46acb-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:33,273 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43146, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:33,280 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33661] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:33,281 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42779] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:33,345 INFO [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:33,345 INFO [Listener at localhost/33455] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:33,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 10:01:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714493346 (current time:1676714493346). 2023-02-18 10:01:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] zookeeper.ReadOnlyZKClient(139): Connect 0x2f21bcff to 127.0.0.1:53471 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:33,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d19460c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:33,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:33,358 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:33,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f21bcff to 127.0.0.1:53471 2023-02-18 10:01:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 10:01:33,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 10:01:33,363 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 10:01:33,364 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676715093364 2023-02-18 10:01:33,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 10:01:33,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,366 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:33,366 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:33,367 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 10:01:33,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 10:01:33,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-18 10:01:33,368 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 10:01:33,369 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676715093369 2023-02-18 10:01:33,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,380 INFO [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-18 10:01:33,380 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:33,381 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-18 10:01:33,381 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 10:01:33,382 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,382 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,383 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,383 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:33,383 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:33,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:33,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:33,383 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,383 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,384 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,384 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-18 10:01:33,384 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-18 10:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-18 10:01:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:33,388 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42779,1676714490874' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 10:01:33,390 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33661,1676714490841' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 10:01:33,391 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,391 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:33,393 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,393 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,393 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:33,393 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:33,394 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,394 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42779,1676714490874' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f208340[Count = 1] remaining members to acquire global barrier 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33661,1676714490841' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 10:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f208340[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:33,397 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 10:01:33,397 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,398 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:33,398 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:33,398 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,398 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:33,398 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. started... 2023-02-18 10:01:33,398 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:33,398 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:33,398 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. started... 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. started... 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. started... 2023-02-18 10:01:33,400 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fdec22565c7839cc2851d97972b77251 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:33,399 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,401 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 87ef94a556e6018271369424f1163fe9 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 10:01:33,399 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 10:01:33,401 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:33,399 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 10:01:33,401 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. started... 2023-02-18 10:01:33,401 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:33,400 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:33,400 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. started... 2023-02-18 10:01:33,401 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2679b8d9e9da1364429364a1903545eb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:33,402 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 12749c25940e67ee9c6ce245df355f25 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:33,402 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,399 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,403 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,403 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:33,403 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:33,403 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,403 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:33,403 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 10:01:33,428 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. completed. 2023-02-18 10:01:33,428 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:33,428 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:33,428 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 10:01:33,428 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. started... 2023-02-18 10:01:33,431 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8a75cd8168eb6271eebb583b01391eb5 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 10:01:33,434 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f1/d54fe52bba0146fca31ce32b2e04520a 2023-02-18 10:01:33,436 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f1/165e1a622a8d4ff2a9d7f7a16c042995 2023-02-18 10:01:33,439 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f1/3b703b8d9f464012a04d3a360e574dd4 2023-02-18 10:01:33,439 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f1/b8113e6eac904f178185eaf6062dcac5 2023-02-18 10:01:33,439 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. completed. 2023-02-18 10:01:33,439 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:33,439 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:33,439 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 10:01:33,439 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. started... 2023-02-18 10:01:33,445 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0d9ae64f235b670d99a3455fc5d7523b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:33,466 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:33,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 10:01:33,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:33,468 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:33,469 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f1/0bda3474ef324c1cbea2104263e89df0 2023-02-18 10:01:33,479 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f2/b6bb805353244913acd61b8b0dbb600c 2023-02-18 10:01:33,485 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f2/96483022078a4cb8bd87b4121ff25d58 2023-02-18 10:01:33,487 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f1/b8113e6eac904f178185eaf6062dcac5 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/b8113e6eac904f178185eaf6062dcac5 2023-02-18 10:01:33,488 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f2/d5ea33b000844df484faffc85eae4ddf 2023-02-18 10:01:33,489 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99 2023-02-18 10:01:33,491 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f1/3b703b8d9f464012a04d3a360e574dd4 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/3b703b8d9f464012a04d3a360e574dd4 2023-02-18 10:01:33,493 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/b8113e6eac904f178185eaf6062dcac5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,494 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f1/165e1a622a8d4ff2a9d7f7a16c042995 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/165e1a622a8d4ff2a9d7f7a16c042995 2023-02-18 10:01:33,494 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f2/b6bb805353244913acd61b8b0dbb600c as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/b6bb805353244913acd61b8b0dbb600c 2023-02-18 10:01:33,496 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f1/d54fe52bba0146fca31ce32b2e04520a as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/d54fe52bba0146fca31ce32b2e04520a 2023-02-18 10:01:33,500 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/165e1a622a8d4ff2a9d7f7a16c042995, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:33,501 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/d54fe52bba0146fca31ce32b2e04520a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,502 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/3b703b8d9f464012a04d3a360e574dd4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,502 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f2/d5ea33b000844df484faffc85eae4ddf as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/d5ea33b000844df484faffc85eae4ddf 2023-02-18 10:01:33,502 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99 2023-02-18 10:01:33,502 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f2/96483022078a4cb8bd87b4121ff25d58 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/96483022078a4cb8bd87b4121ff25d58 2023-02-18 10:01:33,504 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/b6bb805353244913acd61b8b0dbb600c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,506 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 12749c25940e67ee9c6ce245df355f25 in 103ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,506 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-18 10:01:33,506 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:33,506 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,506 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,506 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/b8113e6eac904f178185eaf6062dcac5] hfiles 2023-02-18 10:01:33,506 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/b8113e6eac904f178185eaf6062dcac5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,507 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/b6bb805353244913acd61b8b0dbb600c] hfiles 2023-02-18 10:01:33,507 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/b6bb805353244913acd61b8b0dbb600c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,509 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/96483022078a4cb8bd87b4121ff25d58, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,509 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/d5ea33b000844df484faffc85eae4ddf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:33,510 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f1/9dddd8ad05c4491e9c664ab1beeee066 2023-02-18 10:01:33,510 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,510 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2679b8d9e9da1364429364a1903545eb in 109ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,510 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 87ef94a556e6018271369424f1163fe9 in 109ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,511 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:33,511 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,512 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fdec22565c7839cc2851d97972b77251 in 112ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/3b703b8d9f464012a04d3a360e574dd4] hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/165e1a622a8d4ff2a9d7f7a16c042995] hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/d54fe52bba0146fca31ce32b2e04520a] hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/d54fe52bba0146fca31ce32b2e04520a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/3b703b8d9f464012a04d3a360e574dd4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99] hfiles 2023-02-18 10:01:33,513 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,513 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/96483022078a4cb8bd87b4121ff25d58] hfiles 2023-02-18 10:01:33,512 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/165e1a622a8d4ff2a9d7f7a16c042995 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,513 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/d5ea33b000844df484faffc85eae4ddf] hfiles 2023-02-18 10:01:33,513 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/d5ea33b000844df484faffc85eae4ddf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,513 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/96483022078a4cb8bd87b4121ff25d58 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,516 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f2/4ea78903583342c1a36ac35437101fb3 2023-02-18 10:01:33,526 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f1/0bda3474ef324c1cbea2104263e89df0 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/0bda3474ef324c1cbea2104263e89df0 2023-02-18 10:01:33,527 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. completed. 2023-02-18 10:01:33,527 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:33,528 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 10:01:33,528 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. started... 2023-02-18 10:01:33,529 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b45c94ec7536709f058e2614dccba48c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:33,531 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. completed. 2023-02-18 10:01:33,531 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:33,531 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:33,531 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 10:01:33,531 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. started... 2023-02-18 10:01:33,532 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 898d85681b70eb3f586fde99e89fc87e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 10:01:33,532 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. completed. 2023-02-18 10:01:33,532 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:33,532 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 10:01:33,534 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/0bda3474ef324c1cbea2104263e89df0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:33,535 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f2/4ea78903583342c1a36ac35437101fb3 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/4ea78903583342c1a36ac35437101fb3 2023-02-18 10:01:33,539 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/4ea78903583342c1a36ac35437101fb3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 10:01:33,540 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8a75cd8168eb6271eebb583b01391eb5 in 109ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,540 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:33,540 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,541 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,541 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/0bda3474ef324c1cbea2104263e89df0] hfiles 2023-02-18 10:01:33,541 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/0bda3474ef324c1cbea2104263e89df0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,541 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/4ea78903583342c1a36ac35437101fb3] hfiles 2023-02-18 10:01:33,541 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/4ea78903583342c1a36ac35437101fb3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,542 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f2/1f802ac491d34277a80c1f69aacbe51b 2023-02-18 10:01:33,545 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f1/dd33693f45b543ec87e6bd02a0ec038f 2023-02-18 10:01:33,546 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f1/af4906faf85c4150908d3b2b961d28f4 2023-02-18 10:01:33,550 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. completed. 2023-02-18 10:01:33,550 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 10:01:33,552 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f1/9dddd8ad05c4491e9c664ab1beeee066 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/9dddd8ad05c4491e9c664ab1beeee066 2023-02-18 10:01:33,557 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/9dddd8ad05c4491e9c664ab1beeee066, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,557 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f2/1f802ac491d34277a80c1f69aacbe51b as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/1f802ac491d34277a80c1f69aacbe51b 2023-02-18 10:01:33,561 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f2/a620f561dc864820815f2d5e57974829 2023-02-18 10:01:33,562 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/1f802ac491d34277a80c1f69aacbe51b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,563 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0d9ae64f235b670d99a3455fc5d7523b in 118ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/9dddd8ad05c4491e9c664ab1beeee066] hfiles 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/9dddd8ad05c4491e9c664ab1beeee066 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/1f802ac491d34277a80c1f69aacbe51b] hfiles 2023-02-18 10:01:33,563 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/1f802ac491d34277a80c1f69aacbe51b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,563 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f2/85680bbb62594d5abcf41250401bc161 2023-02-18 10:01:33,567 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f1/af4906faf85c4150908d3b2b961d28f4 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/af4906faf85c4150908d3b2b961d28f4 2023-02-18 10:01:33,569 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f1/dd33693f45b543ec87e6bd02a0ec038f as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/dd33693f45b543ec87e6bd02a0ec038f 2023-02-18 10:01:33,572 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/af4906faf85c4150908d3b2b961d28f4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,573 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f2/a620f561dc864820815f2d5e57974829 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/a620f561dc864820815f2d5e57974829 2023-02-18 10:01:33,574 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/dd33693f45b543ec87e6bd02a0ec038f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,576 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. completed. 2023-02-18 10:01:33,576 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:33,576 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 10:01:33,576 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f2/85680bbb62594d5abcf41250401bc161 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/85680bbb62594d5abcf41250401bc161 2023-02-18 10:01:33,579 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/a620f561dc864820815f2d5e57974829, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,580 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 898d85681b70eb3f586fde99e89fc87e in 48ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/af4906faf85c4150908d3b2b961d28f4] hfiles 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/af4906faf85c4150908d3b2b961d28f4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/a620f561dc864820815f2d5e57974829] hfiles 2023-02-18 10:01:33,580 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/a620f561dc864820815f2d5e57974829 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,580 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/85680bbb62594d5abcf41250401bc161, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 10:01:33,581 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b45c94ec7536709f058e2614dccba48c in 52ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/dd33693f45b543ec87e6bd02a0ec038f] hfiles 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/dd33693f45b543ec87e6bd02a0ec038f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/85680bbb62594d5abcf41250401bc161] hfiles 2023-02-18 10:01:33,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/85680bbb62594d5abcf41250401bc161 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,590 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. completed. 2023-02-18 10:01:33,591 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 10:01:33,591 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. completed. 2023-02-18 10:01:33,591 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 10:01:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 10:01:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 10:01:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42779,1676714490874' in zk 2023-02-18 10:01:33,593 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 10:01:33,593 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,593 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:33,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:33,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:33,593 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 10:01:33,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42779,1676714490874': 2023-02-18 10:01:33,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42779,1676714490874' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 10:01:33,668 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 10:01:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:33,670 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 10:01:33,934 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. completed. 2023-02-18 10:01:33,934 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 10:01:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 10:01:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 10:01:33,935 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33661,1676714490841' in zk 2023-02-18 10:01:33,937 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 10:01:33,937 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,937 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:33,937 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 10:01:33,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33661,1676714490841': 2023-02-18 10:01:33,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33661,1676714490841' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:33,940 INFO [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-18 10:01:33,940 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:33,940 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:33,940 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,940 INFO [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:33,943 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:33,943 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:33,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:33,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:33,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:33,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:33,943 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,944 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,945 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,945 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:33,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:33,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion because node does not exist (not an error) 2023-02-18 10:01:33,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:33,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:33,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:33,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:33,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:33,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:33,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:33,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:33,970 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:33,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 10:01:33,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:33,972 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 10:01:34,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,047 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-18 10:01:34,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,047 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676714493364Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676714493952 (+588 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676714493952Writing data manifest for testWithMockedMapReduceMultiRegion at 1676714493961 (+9 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676714493974 (+13 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676714494047 (+73 ms) 2023-02-18 10:01:34,049 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 10:01:34,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 683 msec 2023-02-18 10:01:34,170 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 10:01:34,472 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:34,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 10:01:34,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:34,473 INFO [Listener at localhost/33455] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:34,477 INFO [Listener at localhost/33455] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:34,482 INFO [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:34,507 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33661] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:34,507 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42779] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:34,567 INFO [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:34,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:34,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,575 INFO [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-18 10:01:34,575 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:34,576 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-18 10:01:34,576 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 10:01:34,577 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,577 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,578 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:34,578 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:34,578 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:34,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:34,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:34,578 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:34,578 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:34,579 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,580 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-18 10:01:34,580 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-18 10:01:34,580 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:34,580 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:34,580 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 10:01:34,581 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 10:01:34,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:34,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. started... 2023-02-18 10:01:34,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:34,581 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:34,584 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:34,584 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. started... 2023-02-18 10:01:34,584 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2679b8d9e9da1364429364a1903545eb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:34,584 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:34,584 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. started... 2023-02-18 10:01:34,584 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fdec22565c7839cc2851d97972b77251 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:34,585 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 10:01:34,585 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:34,585 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:34,585 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:34,586 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. started... 2023-02-18 10:01:34,585 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. started... 2023-02-18 10:01:34,585 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 10:01:34,586 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:34,586 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 10:01:34,586 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:34,586 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:34,586 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. started... 2023-02-18 10:01:34,586 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 12749c25940e67ee9c6ce245df355f25 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:34,586 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0d9ae64f235b670d99a3455fc5d7523b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:34,587 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 87ef94a556e6018271369424f1163fe9 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 10:01:34,586 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. started... 2023-02-18 10:01:34,587 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:34,587 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:34,587 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:34,587 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. started... 2023-02-18 10:01:34,587 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 10:01:34,587 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a75cd8168eb6271eebb583b01391eb5 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 10:01:34,614 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f1/9adaef3a199c4a3b9ad2120f95cf9523 2023-02-18 10:01:34,620 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f1/d9b113e9ae544d1ba9e415dfebcad1cc 2023-02-18 10:01:34,628 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f1/8053101b9deb4708b433af95059f9a2c 2023-02-18 10:01:34,636 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f1/7d2f9b6b4aa74e4fac2c4e13fc431a46 2023-02-18 10:01:34,642 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f1/e675467394cd4a8e86180a0066a4057a 2023-02-18 10:01:34,663 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f2/4848d5a820d7423c9011612329b47718 2023-02-18 10:01:34,670 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f1/9adaef3a199c4a3b9ad2120f95cf9523 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/9adaef3a199c4a3b9ad2120f95cf9523 2023-02-18 10:01:34,676 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f2/71ffefc9a44a42ed8e88072a2e71e7dc 2023-02-18 10:01:34,689 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/9adaef3a199c4a3b9ad2120f95cf9523, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,691 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/.tmp/f2/4848d5a820d7423c9011612329b47718 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/4848d5a820d7423c9011612329b47718 2023-02-18 10:01:34,694 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f1/d9b113e9ae544d1ba9e415dfebcad1cc as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/d9b113e9ae544d1ba9e415dfebcad1cc 2023-02-18 10:01:34,699 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/d9b113e9ae544d1ba9e415dfebcad1cc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,700 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/.tmp/f2/71ffefc9a44a42ed8e88072a2e71e7dc as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/71ffefc9a44a42ed8e88072a2e71e7dc 2023-02-18 10:01:34,706 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/4848d5a820d7423c9011612329b47718, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,708 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fdec22565c7839cc2851d97972b77251 in 124ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,708 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:34,708 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:34,708 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:34,708 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 10:01:34,708 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. started... 2023-02-18 10:01:34,708 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 898d85681b70eb3f586fde99e89fc87e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:34,713 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f2/1fa98bfa79694821b30eec2e4a22c5c6 2023-02-18 10:01:34,713 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f2/34ddd28b5368442b80b1ab1b462c6961 2023-02-18 10:01:34,714 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/71ffefc9a44a42ed8e88072a2e71e7dc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,715 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2679b8d9e9da1364429364a1903545eb in 131ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,716 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:34,716 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:34,716 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:34,716 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. started... 2023-02-18 10:01:34,716 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b45c94ec7536709f058e2614dccba48c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 10:01:34,716 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 10:01:34,725 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f1/e675467394cd4a8e86180a0066a4057a as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/e675467394cd4a8e86180a0066a4057a 2023-02-18 10:01:34,734 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f2/851d561a23644721b5c30f8316956bad 2023-02-18 10:01:34,735 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/e675467394cd4a8e86180a0066a4057a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:34,736 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/.tmp/f2/1fa98bfa79694821b30eec2e4a22c5c6 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/1fa98bfa79694821b30eec2e4a22c5c6 2023-02-18 10:01:34,741 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f1/8053101b9deb4708b433af95059f9a2c as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/8053101b9deb4708b433af95059f9a2c 2023-02-18 10:01:34,742 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f1/7d2f9b6b4aa74e4fac2c4e13fc431a46 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/7d2f9b6b4aa74e4fac2c4e13fc431a46 2023-02-18 10:01:34,745 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/1fa98bfa79694821b30eec2e4a22c5c6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:34,746 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8a75cd8168eb6271eebb583b01391eb5 in 159ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,746 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:34,746 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:34,746 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 10:01:34,747 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/7d2f9b6b4aa74e4fac2c4e13fc431a46, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,747 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/.tmp/f2/851d561a23644721b5c30f8316956bad as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/851d561a23644721b5c30f8316956bad 2023-02-18 10:01:34,754 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/8053101b9deb4708b433af95059f9a2c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:34,754 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/851d561a23644721b5c30f8316956bad, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,755 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/.tmp/f2/34ddd28b5368442b80b1ab1b462c6961 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/34ddd28b5368442b80b1ab1b462c6961 2023-02-18 10:01:34,755 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0d9ae64f235b670d99a3455fc5d7523b in 169ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,755 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:34,755 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:34,755 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 10:01:34,757 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f1/504d091661014a4f827bddd5884f11b3 2023-02-18 10:01:34,758 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f1/e6425d4ef21446f48175b1c0f0e6f192 2023-02-18 10:01:34,763 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/34ddd28b5368442b80b1ab1b462c6961, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 10:01:34,764 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 87ef94a556e6018271369424f1163fe9 in 177ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,764 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:34,764 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:34,764 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 10:01:34,795 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f2/f7f8f94839c84cd0a1c80db32f09eac2 2023-02-18 10:01:34,797 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f2/88f5bc9e95204a3d9168e22d15574c7e 2023-02-18 10:01:34,800 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f1/e6425d4ef21446f48175b1c0f0e6f192 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/e6425d4ef21446f48175b1c0f0e6f192 2023-02-18 10:01:34,801 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f1/504d091661014a4f827bddd5884f11b3 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/504d091661014a4f827bddd5884f11b3 2023-02-18 10:01:34,804 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/e6425d4ef21446f48175b1c0f0e6f192, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,805 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/504d091661014a4f827bddd5884f11b3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,805 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/.tmp/f2/f7f8f94839c84cd0a1c80db32f09eac2 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/f7f8f94839c84cd0a1c80db32f09eac2 2023-02-18 10:01:34,805 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/.tmp/f2/88f5bc9e95204a3d9168e22d15574c7e as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/88f5bc9e95204a3d9168e22d15574c7e 2023-02-18 10:01:34,808 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/f7f8f94839c84cd0a1c80db32f09eac2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,809 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b45c94ec7536709f058e2614dccba48c in 93ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,809 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:34,809 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:34,809 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 10:01:34,813 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/88f5bc9e95204a3d9168e22d15574c7e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:34,814 INFO [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 898d85681b70eb3f586fde99e89fc87e in 106ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:34,814 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:34,814 DEBUG [rs(jenkins-hbase4.apache.org,33661,1676714490841)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 10:01:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 10:01:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 10:01:34,814 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33661,1676714490841' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 10:01:34,816 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,816 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:34,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:34,816 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,816 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:34,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:34,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:34,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:34,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:34,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:34,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33661,1676714490841' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 10:01:34,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b1f107c[Count = 1] remaining members to acquire global barrier 2023-02-18 10:01:35,046 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f1/a973a7ae248b4fffb9f2266fea21355d 2023-02-18 10:01:35,061 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f2/faa424384b734e399eeecccb46c839c7 2023-02-18 10:01:35,066 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f1/a973a7ae248b4fffb9f2266fea21355d as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/a973a7ae248b4fffb9f2266fea21355d 2023-02-18 10:01:35,070 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/a973a7ae248b4fffb9f2266fea21355d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:35,071 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/.tmp/f2/faa424384b734e399eeecccb46c839c7 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/faa424384b734e399eeecccb46c839c7 2023-02-18 10:01:35,074 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/faa424384b734e399eeecccb46c839c7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 10:01:35,075 INFO [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 12749c25940e67ee9c6ce245df355f25 in 489ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:35,075 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:35,075 DEBUG [rs(jenkins-hbase4.apache.org,42779,1676714490874)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 10:01:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 10:01:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 10:01:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42779,1676714490874' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 10:01:35,077 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,077 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:35,077 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,077 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:35,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:35,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:35,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42779,1676714490874' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 10:01:35,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b1f107c[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:35,078 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 10:01:35,079 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 10:01:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 10:01:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 10:01:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42779,1676714490874' in zk 2023-02-18 10:01:35,080 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33661,1676714490841' in zk 2023-02-18 10:01:35,080 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,080 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:35,081 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,081 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 10:01:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:35,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:35,081 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:35,082 DEBUG [member: 'jenkins-hbase4.apache.org,42779,1676714490874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 10:01:35,083 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,083 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 10:01:35,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:35,083 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:35,083 DEBUG [member: 'jenkins-hbase4.apache.org,33661,1676714490841' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 10:01:35,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42779,1676714490874': 2023-02-18 10:01:35,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42779,1676714490874' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 10:01:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33661,1676714490841': 2023-02-18 10:01:35,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33661,1676714490841' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:35,089 INFO [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-18 10:01:35,089 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:35,089 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:35,089 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,089 INFO [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:35,091 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,091 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:35,091 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:35,091 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:35,091 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:35,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:35,092 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,093 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,095 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:35,095 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:35,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,099 DEBUG [(jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:35,098 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:35,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:35,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-18 10:01:35,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:35,099 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:35,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:35,099 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,099 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:35,099 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,099 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,099 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:35,100 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:35,200 DEBUG [Listener at localhost/33455] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:35,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:35,206 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676714493346 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:35,206 DEBUG [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(239): region to add: 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=fdec22565c7839cc2851d97972b77251 as fdec22565c7839cc2851d97972b77251 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=87ef94a556e6018271369424f1163fe9 as 87ef94a556e6018271369424f1163fe9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=48c8fe525a719aa3c4c0e490bee0816d as 48c8fe525a719aa3c4c0e490bee0816d in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=2679b8d9e9da1364429364a1903545eb as 2679b8d9e9da1364429364a1903545eb in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=bb03af14e6d4f71cedbf1352904daaa6 as bb03af14e6d4f71cedbf1352904daaa6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,207 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=12749c25940e67ee9c6ce245df355f25 as 12749c25940e67ee9c6ce245df355f25 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,208 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=8a75cd8168eb6271eebb583b01391eb5 as 8a75cd8168eb6271eebb583b01391eb5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,208 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=0d9ae64f235b670d99a3455fc5d7523b as 0d9ae64f235b670d99a3455fc5d7523b in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,208 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=b45c94ec7536709f058e2614dccba48c as b45c94ec7536709f058e2614dccba48c in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,208 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(585): clone region=898d85681b70eb3f586fde99e89fc87e as 898d85681b70eb3f586fde99e89fc87e in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,209 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0d9ae64f235b670d99a3455fc5d7523b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,209 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => fdec22565c7839cc2851d97972b77251, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,209 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 8a75cd8168eb6271eebb583b01391eb5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,209 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => bb03af14e6d4f71cedbf1352904daaa6, NAME => 'testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,210 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 2679b8d9e9da1364429364a1903545eb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,210 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 48c8fe525a719aa3c4c0e490bee0816d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,210 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 87ef94a556e6018271369424f1163fe9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,210 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 12749c25940e67ee9c6ce245df355f25, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,224 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,225 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing bb03af14e6d4f71cedbf1352904daaa6, disabling compactions & flushes 2023-02-18 10:01:35,225 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:35,225 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:35,225 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. after waiting 0 ms 2023-02-18 10:01:35,225 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:35,225 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:35,225 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:35,225 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => b45c94ec7536709f058e2614dccba48c, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 48c8fe525a719aa3c4c0e490bee0816d, disabling compactions & flushes 2023-02-18 10:01:35,232 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. after waiting 0 ms 2023-02-18 10:01:35,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,232 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,232 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:35,233 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 898d85681b70eb3f586fde99e89fc87e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,246 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,246 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9dddd8ad05c4491e9c664ab1beeee066 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,255 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,255 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b8113e6eac904f178185eaf6062dcac5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,264 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,264 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,264 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d54fe52bba0146fca31ce32b2e04520a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,264 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 165e1a622a8d4ff2a9d7f7a16c042995 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,266 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f802ac491d34277a80c1f69aacbe51b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,273 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e322b66f1c3c4f5f929f4b6c0dd1dc99 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,273 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0d9ae64f235b670d99a3455fc5d7523b, disabling compactions & flushes 2023-02-18 10:01:35,273 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,273 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,273 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. after waiting 0 ms 2023-02-18 10:01:35,273 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,273 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,273 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:35,273 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b6bb805353244913acd61b8b0dbb600c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,275 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,275 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0bda3474ef324c1cbea2104263e89df0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,275 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,275 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af4906faf85c4150908d3b2b961d28f4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,275 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,275 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b703b8d9f464012a04d3a360e574dd4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,279 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d5ea33b000844df484faffc85eae4ddf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,279 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,279 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd33693f45b543ec87e6bd02a0ec038f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,280 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing fdec22565c7839cc2851d97972b77251, disabling compactions & flushes 2023-02-18 10:01:35,280 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,280 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,280 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. after waiting 0 ms 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96483022078a4cb8bd87b4121ff25d58 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a620f561dc864820815f2d5e57974829 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4ea78903583342c1a36ac35437101fb3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 12749c25940e67ee9c6ce245df355f25, disabling compactions & flushes 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. after waiting 0 ms 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85680bbb62594d5abcf41250401bc161 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:35,281 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 87ef94a556e6018271369424f1163fe9, disabling compactions & flushes 2023-02-18 10:01:35,281 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,282 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,282 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. after waiting 0 ms 2023-02-18 10:01:35,282 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,282 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,282 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:35,283 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 8a75cd8168eb6271eebb583b01391eb5, disabling compactions & flushes 2023-02-18 10:01:35,283 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:35,283 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 898d85681b70eb3f586fde99e89fc87e, disabling compactions & flushes 2023-02-18 10:01:35,283 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:35,283 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:35,283 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. after waiting 0 ms 2023-02-18 10:01:35,283 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. after waiting 0 ms 2023-02-18 10:01:35,284 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:35,284 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 2679b8d9e9da1364429364a1903545eb, disabling compactions & flushes 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:35,284 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. after waiting 0 ms 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:35,284 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing b45c94ec7536709f058e2614dccba48c, disabling compactions & flushes 2023-02-18 10:01:35,284 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. after waiting 0 ms 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,284 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:35,285 INFO [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676714493346 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:35,285 DEBUG [Listener at localhost/33455] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,285 DEBUG [Listener at localhost/33455] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9 2023-02-18 10:01:35,285 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:35,286 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:35,286 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-18 10:01:35,286 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------0d9ae64f235b670d99a3455fc5d7523b/ 2023-02-18 10:01:35,287 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,287 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,287 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0d9ae64f235b670d99a3455fc5d7523b-9dddd8ad05c4491e9c664ab1beeee066 2023-02-18 10:01:35,287 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,287 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0d9ae64f235b670d99a3455fc5d7523b-1f802ac491d34277a80c1f69aacbe51b 2023-02-18 10:01:35,287 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------12749c25940e67ee9c6ce245df355f25/ 2023-02-18 10:01:35,288 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,288 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,288 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=12749c25940e67ee9c6ce245df355f25-b8113e6eac904f178185eaf6062dcac5 2023-02-18 10:01:35,288 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,288 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=12749c25940e67ee9c6ce245df355f25-b6bb805353244913acd61b8b0dbb600c 2023-02-18 10:01:35,289 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------2679b8d9e9da1364429364a1903545eb/ 2023-02-18 10:01:35,289 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,289 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,289 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2679b8d9e9da1364429364a1903545eb-3b703b8d9f464012a04d3a360e574dd4 2023-02-18 10:01:35,289 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,289 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2679b8d9e9da1364429364a1903545eb-96483022078a4cb8bd87b4121ff25d58 2023-02-18 10:01:35,290 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------48c8fe525a719aa3c4c0e490bee0816d/ 2023-02-18 10:01:35,290 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,290 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------87ef94a556e6018271369424f1163fe9/ 2023-02-18 10:01:35,290 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,290 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,291 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=87ef94a556e6018271369424f1163fe9-165e1a622a8d4ff2a9d7f7a16c042995 2023-02-18 10:01:35,291 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,291 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=87ef94a556e6018271369424f1163fe9-d5ea33b000844df484faffc85eae4ddf 2023-02-18 10:01:35,291 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------898d85681b70eb3f586fde99e89fc87e/ 2023-02-18 10:01:35,291 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,291 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,292 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=898d85681b70eb3f586fde99e89fc87e-af4906faf85c4150908d3b2b961d28f4 2023-02-18 10:01:35,292 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,292 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=898d85681b70eb3f586fde99e89fc87e-a620f561dc864820815f2d5e57974829 2023-02-18 10:01:35,292 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------8a75cd8168eb6271eebb583b01391eb5/ 2023-02-18 10:01:35,292 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,292 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,293 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a75cd8168eb6271eebb583b01391eb5-0bda3474ef324c1cbea2104263e89df0 2023-02-18 10:01:35,293 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,293 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8a75cd8168eb6271eebb583b01391eb5-4ea78903583342c1a36ac35437101fb3 2023-02-18 10:01:35,293 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------b45c94ec7536709f058e2614dccba48c/ 2023-02-18 10:01:35,293 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,293 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,294 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b45c94ec7536709f058e2614dccba48c-dd33693f45b543ec87e6bd02a0ec038f 2023-02-18 10:01:35,294 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,294 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b45c94ec7536709f058e2614dccba48c-85680bbb62594d5abcf41250401bc161 2023-02-18 10:01:35,294 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------bb03af14e6d4f71cedbf1352904daaa6/ 2023-02-18 10:01:35,294 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,294 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |----------fdec22565c7839cc2851d97972b77251/ 2023-02-18 10:01:35,295 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:35,295 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:35,295 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fdec22565c7839cc2851d97972b77251-d54fe52bba0146fca31ce32b2e04520a 2023-02-18 10:01:35,295 DEBUG [Listener at localhost/33455] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:35,295 DEBUG [Listener at localhost/33455] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fdec22565c7839cc2851d97972b77251-e322b66f1c3c4f5f929f4b6c0dd1dc99 2023-02-18 10:01:35,298 INFO [Listener at localhost/33455] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 10:01:35,848 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,848 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:35,849 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:35,851 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:35,852 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1 2023-02-18 10:01:35,852 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d9ae64f235b670d99a3455fc5d7523b columnFamilyName f1 2023-02-18 10:01:35,856 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/testWithMockedMapReduceMultiRegion=0d9ae64f235b670d99a3455fc5d7523b-9dddd8ad05c4491e9c664ab1beeee066 2023-02-18 10:01:35,856 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(310): Store=0d9ae64f235b670d99a3455fc5d7523b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,856 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:35,857 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2 2023-02-18 10:01:35,857 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d9ae64f235b670d99a3455fc5d7523b columnFamilyName f2 2023-02-18 10:01:35,861 DEBUG [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/testWithMockedMapReduceMultiRegion=0d9ae64f235b670d99a3455fc5d7523b-1f802ac491d34277a80c1f69aacbe51b 2023-02-18 10:01:35,861 INFO [StoreOpener-0d9ae64f235b670d99a3455fc5d7523b-1] regionserver.HStore(310): Store=0d9ae64f235b670d99a3455fc5d7523b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,861 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:35,861 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 0d9ae64f235b670d99a3455fc5d7523b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58842401, jitterRate=-0.12317989766597748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:35,861 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:35,872 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 0d9ae64f235b670d99a3455fc5d7523b, disabling compactions & flushes 2023-02-18 10:01:35,873 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,873 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,873 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. after waiting 0 ms 2023-02-18 10:01:35,873 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,874 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:35,874 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:35,875 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,875 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:35,877 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:35,879 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:35,880 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1 2023-02-18 10:01:35,880 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ef94a556e6018271369424f1163fe9 columnFamilyName f1 2023-02-18 10:01:35,888 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/testWithMockedMapReduceMultiRegion=87ef94a556e6018271369424f1163fe9-165e1a622a8d4ff2a9d7f7a16c042995 2023-02-18 10:01:35,888 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(310): Store=87ef94a556e6018271369424f1163fe9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,888 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:35,889 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2 2023-02-18 10:01:35,889 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ef94a556e6018271369424f1163fe9 columnFamilyName f2 2023-02-18 10:01:35,894 DEBUG [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/testWithMockedMapReduceMultiRegion=87ef94a556e6018271369424f1163fe9-d5ea33b000844df484faffc85eae4ddf 2023-02-18 10:01:35,894 INFO [StoreOpener-87ef94a556e6018271369424f1163fe9-1] regionserver.HStore(310): Store=87ef94a556e6018271369424f1163fe9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,894 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:35,894 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 87ef94a556e6018271369424f1163fe9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71980958, jitterRate=0.072599858045578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:35,894 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:35,906 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 87ef94a556e6018271369424f1163fe9, disabling compactions & flushes 2023-02-18 10:01:35,906 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,906 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,906 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. after waiting 0 ms 2023-02-18 10:01:35,907 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,908 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:35,908 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:35,908 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,909 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:35,910 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:35,912 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:35,913 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1 2023-02-18 10:01:35,913 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12749c25940e67ee9c6ce245df355f25 columnFamilyName f1 2023-02-18 10:01:35,918 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/testWithMockedMapReduceMultiRegion=12749c25940e67ee9c6ce245df355f25-b8113e6eac904f178185eaf6062dcac5 2023-02-18 10:01:35,918 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(310): Store=12749c25940e67ee9c6ce245df355f25/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,919 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:35,919 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2 2023-02-18 10:01:35,920 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12749c25940e67ee9c6ce245df355f25 columnFamilyName f2 2023-02-18 10:01:35,924 DEBUG [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/testWithMockedMapReduceMultiRegion=12749c25940e67ee9c6ce245df355f25-b6bb805353244913acd61b8b0dbb600c 2023-02-18 10:01:35,924 INFO [StoreOpener-12749c25940e67ee9c6ce245df355f25-1] regionserver.HStore(310): Store=12749c25940e67ee9c6ce245df355f25/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,924 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:35,924 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 12749c25940e67ee9c6ce245df355f25; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62268809, jitterRate=-0.07212243974208832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:35,924 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:35,933 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 12749c25940e67ee9c6ce245df355f25, disabling compactions & flushes 2023-02-18 10:01:35,934 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,934 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,934 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. after waiting 0 ms 2023-02-18 10:01:35,934 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,935 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:35,935 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:35,935 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,935 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:35,937 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:35,938 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:35,940 DEBUG [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f1 2023-02-18 10:01:35,940 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48c8fe525a719aa3c4c0e490bee0816d columnFamilyName f1 2023-02-18 10:01:35,941 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(310): Store=48c8fe525a719aa3c4c0e490bee0816d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,941 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:35,942 DEBUG [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f2 2023-02-18 10:01:35,942 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48c8fe525a719aa3c4c0e490bee0816d columnFamilyName f2 2023-02-18 10:01:35,942 INFO [StoreOpener-48c8fe525a719aa3c4c0e490bee0816d-1] regionserver.HStore(310): Store=48c8fe525a719aa3c4c0e490bee0816d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,942 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:35,943 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 48c8fe525a719aa3c4c0e490bee0816d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61163579, jitterRate=-0.08859165012836456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:35,943 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:35,943 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 48c8fe525a719aa3c4c0e490bee0816d, disabling compactions & flushes 2023-02-18 10:01:35,943 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,943 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,943 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. after waiting 0 ms 2023-02-18 10:01:35,943 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,943 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:35,944 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:35,944 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,944 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:35,946 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:35,948 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:35,948 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1 2023-02-18 10:01:35,949 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdec22565c7839cc2851d97972b77251 columnFamilyName f1 2023-02-18 10:01:35,953 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/testWithMockedMapReduceMultiRegion=fdec22565c7839cc2851d97972b77251-d54fe52bba0146fca31ce32b2e04520a 2023-02-18 10:01:35,953 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(310): Store=fdec22565c7839cc2851d97972b77251/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,953 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:35,954 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2 2023-02-18 10:01:35,954 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdec22565c7839cc2851d97972b77251 columnFamilyName f2 2023-02-18 10:01:35,958 DEBUG [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/testWithMockedMapReduceMultiRegion=fdec22565c7839cc2851d97972b77251-e322b66f1c3c4f5f929f4b6c0dd1dc99 2023-02-18 10:01:35,958 INFO [StoreOpener-fdec22565c7839cc2851d97972b77251-1] regionserver.HStore(310): Store=fdec22565c7839cc2851d97972b77251/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,958 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:35,959 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened fdec22565c7839cc2851d97972b77251; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61510741, jitterRate=-0.08341853320598602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:35,959 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:35,968 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing fdec22565c7839cc2851d97972b77251, disabling compactions & flushes 2023-02-18 10:01:35,968 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,968 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,968 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. after waiting 0 ms 2023-02-18 10:01:35,968 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,969 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:35,970 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:35,970 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,970 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:35,974 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:35,977 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:35,977 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1 2023-02-18 10:01:35,978 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b45c94ec7536709f058e2614dccba48c columnFamilyName f1 2023-02-18 10:01:35,981 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/testWithMockedMapReduceMultiRegion=b45c94ec7536709f058e2614dccba48c-dd33693f45b543ec87e6bd02a0ec038f 2023-02-18 10:01:35,981 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(310): Store=b45c94ec7536709f058e2614dccba48c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,982 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:35,982 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2 2023-02-18 10:01:35,983 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b45c94ec7536709f058e2614dccba48c columnFamilyName f2 2023-02-18 10:01:35,986 DEBUG [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/testWithMockedMapReduceMultiRegion=b45c94ec7536709f058e2614dccba48c-85680bbb62594d5abcf41250401bc161 2023-02-18 10:01:35,986 INFO [StoreOpener-b45c94ec7536709f058e2614dccba48c-1] regionserver.HStore(310): Store=b45c94ec7536709f058e2614dccba48c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:35,987 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:35,987 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened b45c94ec7536709f058e2614dccba48c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67379224, jitterRate=0.004028677940368652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:35,987 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:35,995 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing b45c94ec7536709f058e2614dccba48c, disabling compactions & flushes 2023-02-18 10:01:35,995 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,995 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,995 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. after waiting 0 ms 2023-02-18 10:01:35,995 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,996 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:35,996 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:35,996 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:35,997 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:36,001 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:36,005 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:36,006 DEBUG [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f1 2023-02-18 10:01:36,006 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb03af14e6d4f71cedbf1352904daaa6 columnFamilyName f1 2023-02-18 10:01:36,007 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(310): Store=bb03af14e6d4f71cedbf1352904daaa6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,007 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:36,008 DEBUG [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f2 2023-02-18 10:01:36,008 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb03af14e6d4f71cedbf1352904daaa6 columnFamilyName f2 2023-02-18 10:01:36,010 INFO [StoreOpener-bb03af14e6d4f71cedbf1352904daaa6-1] regionserver.HStore(310): Store=bb03af14e6d4f71cedbf1352904daaa6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,010 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:36,010 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened bb03af14e6d4f71cedbf1352904daaa6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63564500, jitterRate=-0.052815139293670654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:36,011 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:36,011 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing bb03af14e6d4f71cedbf1352904daaa6, disabling compactions & flushes 2023-02-18 10:01:36,011 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,011 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,011 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. after waiting 0 ms 2023-02-18 10:01:36,011 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,011 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,011 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:36,012 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:36,012 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:36,014 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:36,016 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:36,017 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1 2023-02-18 10:01:36,017 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 898d85681b70eb3f586fde99e89fc87e columnFamilyName f1 2023-02-18 10:01:36,024 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/testWithMockedMapReduceMultiRegion=898d85681b70eb3f586fde99e89fc87e-af4906faf85c4150908d3b2b961d28f4 2023-02-18 10:01:36,024 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(310): Store=898d85681b70eb3f586fde99e89fc87e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,024 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:36,025 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2 2023-02-18 10:01:36,025 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 898d85681b70eb3f586fde99e89fc87e columnFamilyName f2 2023-02-18 10:01:36,034 DEBUG [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/testWithMockedMapReduceMultiRegion=898d85681b70eb3f586fde99e89fc87e-a620f561dc864820815f2d5e57974829 2023-02-18 10:01:36,034 INFO [StoreOpener-898d85681b70eb3f586fde99e89fc87e-1] regionserver.HStore(310): Store=898d85681b70eb3f586fde99e89fc87e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,035 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:36,035 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 898d85681b70eb3f586fde99e89fc87e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73651528, jitterRate=0.09749329090118408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:36,035 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:36,048 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 898d85681b70eb3f586fde99e89fc87e, disabling compactions & flushes 2023-02-18 10:01:36,048 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,048 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,048 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. after waiting 0 ms 2023-02-18 10:01:36,048 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,060 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,060 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:36,061 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:36,061 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:36,063 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:36,065 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:36,066 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1 2023-02-18 10:01:36,067 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2679b8d9e9da1364429364a1903545eb columnFamilyName f1 2023-02-18 10:01:36,079 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/testWithMockedMapReduceMultiRegion=2679b8d9e9da1364429364a1903545eb-3b703b8d9f464012a04d3a360e574dd4 2023-02-18 10:01:36,079 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(310): Store=2679b8d9e9da1364429364a1903545eb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,079 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:36,080 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2 2023-02-18 10:01:36,081 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2679b8d9e9da1364429364a1903545eb columnFamilyName f2 2023-02-18 10:01:36,084 DEBUG [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/testWithMockedMapReduceMultiRegion=2679b8d9e9da1364429364a1903545eb-96483022078a4cb8bd87b4121ff25d58 2023-02-18 10:01:36,085 INFO [StoreOpener-2679b8d9e9da1364429364a1903545eb-1] regionserver.HStore(310): Store=2679b8d9e9da1364429364a1903545eb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,085 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:36,085 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 2679b8d9e9da1364429364a1903545eb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67376679, jitterRate=0.00399075448513031}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:36,085 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:36,093 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 2679b8d9e9da1364429364a1903545eb, disabling compactions & flushes 2023-02-18 10:01:36,094 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,094 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,094 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. after waiting 0 ms 2023-02-18 10:01:36,094 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,095 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,095 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:36,095 DEBUG [Listener at localhost/33455] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:36,095 INFO [Listener at localhost/33455] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:36,098 DEBUG [Listener at localhost/33455] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:36,100 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:36,101 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1 2023-02-18 10:01:36,101 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a75cd8168eb6271eebb583b01391eb5 columnFamilyName f1 2023-02-18 10:01:36,106 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/testWithMockedMapReduceMultiRegion=8a75cd8168eb6271eebb583b01391eb5-0bda3474ef324c1cbea2104263e89df0 2023-02-18 10:01:36,106 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(310): Store=8a75cd8168eb6271eebb583b01391eb5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,106 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:36,107 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2 2023-02-18 10:01:36,108 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a75cd8168eb6271eebb583b01391eb5 columnFamilyName f2 2023-02-18 10:01:36,111 DEBUG [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(539): loaded hdfs://localhost:44109/user/jenkins/test-data/d0f15998-0d22-12a7-c5de-fce4c503ad43/testWithMockedMapReduceMultiRegion/a3c4d155-0d3c-4033-a1e4-52786ea7e4f9/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/testWithMockedMapReduceMultiRegion=8a75cd8168eb6271eebb583b01391eb5-4ea78903583342c1a36ac35437101fb3 2023-02-18 10:01:36,111 INFO [StoreOpener-8a75cd8168eb6271eebb583b01391eb5-1] regionserver.HStore(310): Store=8a75cd8168eb6271eebb583b01391eb5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:36,111 DEBUG [Listener at localhost/33455] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:36,111 INFO [Listener at localhost/33455] regionserver.HRegion(1071): Opened 8a75cd8168eb6271eebb583b01391eb5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72155634, jitterRate=0.07520273327827454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:36,111 DEBUG [Listener at localhost/33455] regionserver.HRegion(964): Region open journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:36,169 DEBUG [Listener at localhost/33455] regionserver.HRegion(1603): Closing 8a75cd8168eb6271eebb583b01391eb5, disabling compactions & flushes 2023-02-18 10:01:36,169 INFO [Listener at localhost/33455] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,169 DEBUG [Listener at localhost/33455] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,169 DEBUG [Listener at localhost/33455] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. after waiting 0 ms 2023-02-18 10:01:36,169 DEBUG [Listener at localhost/33455] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,176 INFO [Listener at localhost/33455] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,176 DEBUG [Listener at localhost/33455] regionserver.HRegion(1557): Region close journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:36,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-18 10:01:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,187 INFO [Listener at localhost/33455] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:36,191 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714496191"}]},"ts":"1676714496191"} 2023-02-18 10:01:36,193 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-18 10:01:36,194 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-18 10:01:36,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, UNASSIGN}] 2023-02-18 10:01:36,197 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, UNASSIGN 2023-02-18 10:01:36,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=48c8fe525a719aa3c4c0e490bee0816d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,198 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714496197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496197"}]},"ts":"1676714496197"} 2023-02-18 10:01:36,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 48c8fe525a719aa3c4c0e490bee0816d, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:36,201 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, UNASSIGN 2023-02-18 10:01:36,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=87ef94a556e6018271369424f1163fe9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496202"}]},"ts":"1676714496202"} 2023-02-18 10:01:36,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=42, state=RUNNABLE; CloseRegionProcedure 87ef94a556e6018271369424f1163fe9, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:36,205 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, UNASSIGN 2023-02-18 10:01:36,206 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=fdec22565c7839cc2851d97972b77251, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496206"}]},"ts":"1676714496206"} 2023-02-18 10:01:36,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure fdec22565c7839cc2851d97972b77251, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:36,209 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, UNASSIGN 2023-02-18 10:01:36,209 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, UNASSIGN 2023-02-18 10:01:36,209 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, UNASSIGN 2023-02-18 10:01:36,209 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, UNASSIGN 2023-02-18 10:01:36,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=898d85681b70eb3f586fde99e89fc87e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0d9ae64f235b670d99a3455fc5d7523b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496210"}]},"ts":"1676714496210"} 2023-02-18 10:01:36,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496210"}]},"ts":"1676714496210"} 2023-02-18 10:01:36,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2679b8d9e9da1364429364a1903545eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=12749c25940e67ee9c6ce245df355f25, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496210"}]},"ts":"1676714496210"} 2023-02-18 10:01:36,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496210"}]},"ts":"1676714496210"} 2023-02-18 10:01:36,212 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, UNASSIGN 2023-02-18 10:01:36,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure 898d85681b70eb3f586fde99e89fc87e, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:36,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=38, state=RUNNABLE; CloseRegionProcedure 0d9ae64f235b670d99a3455fc5d7523b, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:36,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b45c94ec7536709f058e2614dccba48c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496213"}]},"ts":"1676714496213"} 2023-02-18 10:01:36,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure 2679b8d9e9da1364429364a1903545eb, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:36,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=36, state=RUNNABLE; CloseRegionProcedure 12749c25940e67ee9c6ce245df355f25, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:36,216 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, UNASSIGN 2023-02-18 10:01:36,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure b45c94ec7536709f058e2614dccba48c, server=jenkins-hbase4.apache.org,42779,1676714490874}] 2023-02-18 10:01:36,217 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8a75cd8168eb6271eebb583b01391eb5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,217 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496217"}]},"ts":"1676714496217"} 2023-02-18 10:01:36,218 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, UNASSIGN 2023-02-18 10:01:36,219 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=bb03af14e6d4f71cedbf1352904daaa6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 8a75cd8168eb6271eebb583b01391eb5, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:36,223 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714496219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714496219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714496219"}]},"ts":"1676714496219"} 2023-02-18 10:01:36,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure bb03af14e6d4f71cedbf1352904daaa6, server=jenkins-hbase4.apache.org,33661,1676714490841}] 2023-02-18 10:01:36,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:36,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:36,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2679b8d9e9da1364429364a1903545eb, disabling compactions & flushes 2023-02-18 10:01:36,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. after waiting 0 ms 2023-02-18 10:01:36,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:36,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bb03af14e6d4f71cedbf1352904daaa6, disabling compactions & flushes 2023-02-18 10:01:36,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. after waiting 0 ms 2023-02-18 10:01:36,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 10:01:36,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb. 2023-02-18 10:01:36,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2679b8d9e9da1364429364a1903545eb: 2023-02-18 10:01:36,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6. 2023-02-18 10:01:36,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bb03af14e6d4f71cedbf1352904daaa6: 2023-02-18 10:01:36,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:36,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:36,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d9ae64f235b670d99a3455fc5d7523b, disabling compactions & flushes 2023-02-18 10:01:36,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:36,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:36,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. after waiting 0 ms 2023-02-18 10:01:36,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:36,363 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2679b8d9e9da1364429364a1903545eb, regionState=CLOSED 2023-02-18 10:01:36,363 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496363"}]},"ts":"1676714496363"} 2023-02-18 10:01:36,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:36,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:36,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fdec22565c7839cc2851d97972b77251, disabling compactions & flushes 2023-02-18 10:01:36,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:36,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:36,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. after waiting 0 ms 2023-02-18 10:01:36,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:36,364 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=bb03af14e6d4f71cedbf1352904daaa6, regionState=CLOSED 2023-02-18 10:01:36,364 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714496364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496364"}]},"ts":"1676714496364"} 2023-02-18 10:01:36,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-18 10:01:36,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure 2679b8d9e9da1364429364a1903545eb, server=jenkins-hbase4.apache.org,42779,1676714490874 in 151 msec 2023-02-18 10:01:36,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-18 10:01:36,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure bb03af14e6d4f71cedbf1352904daaa6, server=jenkins-hbase4.apache.org,33661,1676714490841 in 140 msec 2023-02-18 10:01:36,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2679b8d9e9da1364429364a1903545eb, UNASSIGN in 171 msec 2023-02-18 10:01:36,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bb03af14e6d4f71cedbf1352904daaa6, UNASSIGN in 171 msec 2023-02-18 10:01:36,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b. 2023-02-18 10:01:36,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d9ae64f235b670d99a3455fc5d7523b: 2023-02-18 10:01:36,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251. 2023-02-18 10:01:36,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fdec22565c7839cc2851d97972b77251: 2023-02-18 10:01:36,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:36,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 12749c25940e67ee9c6ce245df355f25, disabling compactions & flushes 2023-02-18 10:01:36,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. after waiting 0 ms 2023-02-18 10:01:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:36,374 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0d9ae64f235b670d99a3455fc5d7523b, regionState=CLOSED 2023-02-18 10:01:36,374 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496374"}]},"ts":"1676714496374"} 2023-02-18 10:01:36,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:36,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:36,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 898d85681b70eb3f586fde99e89fc87e, disabling compactions & flushes 2023-02-18 10:01:36,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. after waiting 0 ms 2023-02-18 10:01:36,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,375 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=fdec22565c7839cc2851d97972b77251, regionState=CLOSED 2023-02-18 10:01:36,375 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496375"}]},"ts":"1676714496375"} 2023-02-18 10:01:36,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=38 2023-02-18 10:01:36,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=38, state=SUCCESS; CloseRegionProcedure 0d9ae64f235b670d99a3455fc5d7523b, server=jenkins-hbase4.apache.org,42779,1676714490874 in 163 msec 2023-02-18 10:01:36,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-18 10:01:36,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure fdec22565c7839cc2851d97972b77251, server=jenkins-hbase4.apache.org,33661,1676714490841 in 170 msec 2023-02-18 10:01:36,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0d9ae64f235b670d99a3455fc5d7523b, UNASSIGN in 183 msec 2023-02-18 10:01:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdec22565c7839cc2851d97972b77251, UNASSIGN in 183 msec 2023-02-18 10:01:36,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e. 2023-02-18 10:01:36,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 898d85681b70eb3f586fde99e89fc87e: 2023-02-18 10:01:36,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25. 2023-02-18 10:01:36,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 12749c25940e67ee9c6ce245df355f25: 2023-02-18 10:01:36,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:36,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:36,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87ef94a556e6018271369424f1163fe9, disabling compactions & flushes 2023-02-18 10:01:36,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:36,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:36,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. after waiting 0 ms 2023-02-18 10:01:36,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:36,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=898d85681b70eb3f586fde99e89fc87e, regionState=CLOSED 2023-02-18 10:01:36,382 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496382"}]},"ts":"1676714496382"} 2023-02-18 10:01:36,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:36,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b45c94ec7536709f058e2614dccba48c, disabling compactions & flushes 2023-02-18 10:01:36,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. after waiting 0 ms 2023-02-18 10:01:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:36,383 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=12749c25940e67ee9c6ce245df355f25, regionState=CLOSED 2023-02-18 10:01:36,383 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496383"}]},"ts":"1676714496383"} 2023-02-18 10:01:36,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-18 10:01:36,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure 898d85681b70eb3f586fde99e89fc87e, server=jenkins-hbase4.apache.org,33661,1676714490841 in 171 msec 2023-02-18 10:01:36,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=36 2023-02-18 10:01:36,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=36, state=SUCCESS; CloseRegionProcedure 12749c25940e67ee9c6ce245df355f25, server=jenkins-hbase4.apache.org,42779,1676714490874 in 169 msec 2023-02-18 10:01:36,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=898d85681b70eb3f586fde99e89fc87e, UNASSIGN in 190 msec 2023-02-18 10:01:36,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12749c25940e67ee9c6ce245df355f25, UNASSIGN in 191 msec 2023-02-18 10:01:36,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9. 2023-02-18 10:01:36,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87ef94a556e6018271369424f1163fe9: 2023-02-18 10:01:36,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c. 2023-02-18 10:01:36,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b45c94ec7536709f058e2614dccba48c: 2023-02-18 10:01:36,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:36,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:36,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8a75cd8168eb6271eebb583b01391eb5, disabling compactions & flushes 2023-02-18 10:01:36,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. after waiting 0 ms 2023-02-18 10:01:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=87ef94a556e6018271369424f1163fe9, regionState=CLOSED 2023-02-18 10:01:36,391 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496391"}]},"ts":"1676714496391"} 2023-02-18 10:01:36,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:36,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 48c8fe525a719aa3c4c0e490bee0816d, disabling compactions & flushes 2023-02-18 10:01:36,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. after waiting 0 ms 2023-02-18 10:01:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:36,392 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b45c94ec7536709f058e2614dccba48c, regionState=CLOSED 2023-02-18 10:01:36,392 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496391"}]},"ts":"1676714496391"} 2023-02-18 10:01:36,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=42 2023-02-18 10:01:36,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=42, state=SUCCESS; CloseRegionProcedure 87ef94a556e6018271369424f1163fe9, server=jenkins-hbase4.apache.org,33661,1676714490841 in 189 msec 2023-02-18 10:01:36,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-18 10:01:36,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure b45c94ec7536709f058e2614dccba48c, server=jenkins-hbase4.apache.org,42779,1676714490874 in 176 msec 2023-02-18 10:01:36,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ef94a556e6018271369424f1163fe9, UNASSIGN in 199 msec 2023-02-18 10:01:36,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b45c94ec7536709f058e2614dccba48c, UNASSIGN in 200 msec 2023-02-18 10:01:36,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 10:01:36,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d. 2023-02-18 10:01:36,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 48c8fe525a719aa3c4c0e490bee0816d: 2023-02-18 10:01:36,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:36,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5. 2023-02-18 10:01:36,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8a75cd8168eb6271eebb583b01391eb5: 2023-02-18 10:01:36,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:36,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=48c8fe525a719aa3c4c0e490bee0816d, regionState=CLOSED 2023-02-18 10:01:36,399 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676714496399"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496399"}]},"ts":"1676714496399"} 2023-02-18 10:01:36,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:36,400 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8a75cd8168eb6271eebb583b01391eb5, regionState=CLOSED 2023-02-18 10:01:36,400 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676714496400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714496400"}]},"ts":"1676714496400"} 2023-02-18 10:01:36,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-18 10:01:36,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 48c8fe525a719aa3c4c0e490bee0816d, server=jenkins-hbase4.apache.org,42779,1676714490874 in 202 msec 2023-02-18 10:01:36,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-18 10:01:36,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 8a75cd8168eb6271eebb583b01391eb5, server=jenkins-hbase4.apache.org,33661,1676714490841 in 182 msec 2023-02-18 10:01:36,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=48c8fe525a719aa3c4c0e490bee0816d, UNASSIGN in 207 msec 2023-02-18 10:01:36,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-18 10:01:36,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8a75cd8168eb6271eebb583b01391eb5, UNASSIGN in 207 msec 2023-02-18 10:01:36,404 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714496404"}]},"ts":"1676714496404"} 2023-02-18 10:01:36,405 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-18 10:01:36,407 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-18 10:01:36,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 221 msec 2023-02-18 10:01:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 10:01:36,495 INFO [Listener at localhost/33455] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-18 10:01:36,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,498 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:36,511 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:36,514 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/recovered.edits] 2023-02-18 10:01:36,514 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/recovered.edits] 2023-02-18 10:01:36,514 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/recovered.edits] 2023-02-18 10:01:36,515 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/recovered.edits] 2023-02-18 10:01:36,515 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/recovered.edits] 2023-02-18 10:01:36,515 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/recovered.edits] 2023-02-18 10:01:36,516 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/recovered.edits] 2023-02-18 10:01:36,516 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/recovered.edits] 2023-02-18 10:01:36,522 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/504d091661014a4f827bddd5884f11b3 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/504d091661014a4f827bddd5884f11b3 2023-02-18 10:01:36,522 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/a973a7ae248b4fffb9f2266fea21355d to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/a973a7ae248b4fffb9f2266fea21355d 2023-02-18 10:01:36,522 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/3b703b8d9f464012a04d3a360e574dd4 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/3b703b8d9f464012a04d3a360e574dd4 2023-02-18 10:01:36,523 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/dd33693f45b543ec87e6bd02a0ec038f to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/dd33693f45b543ec87e6bd02a0ec038f 2023-02-18 10:01:36,524 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/0bda3474ef324c1cbea2104263e89df0 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/0bda3474ef324c1cbea2104263e89df0 2023-02-18 10:01:36,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/9adaef3a199c4a3b9ad2120f95cf9523 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/9adaef3a199c4a3b9ad2120f95cf9523 2023-02-18 10:01:36,524 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/b8113e6eac904f178185eaf6062dcac5 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f1/b8113e6eac904f178185eaf6062dcac5 2023-02-18 10:01:36,525 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/af4906faf85c4150908d3b2b961d28f4 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f1/af4906faf85c4150908d3b2b961d28f4 2023-02-18 10:01:36,525 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/d9b113e9ae544d1ba9e415dfebcad1cc to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f1/d9b113e9ae544d1ba9e415dfebcad1cc 2023-02-18 10:01:36,526 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/recovered.edits/6.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6/recovered.edits/6.seqid 2023-02-18 10:01:36,526 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/7d2f9b6b4aa74e4fac2c4e13fc431a46 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/7d2f9b6b4aa74e4fac2c4e13fc431a46 2023-02-18 10:01:36,526 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/e6425d4ef21446f48175b1c0f0e6f192 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f1/e6425d4ef21446f48175b1c0f0e6f192 2023-02-18 10:01:36,526 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/e675467394cd4a8e86180a0066a4057a to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f1/e675467394cd4a8e86180a0066a4057a 2023-02-18 10:01:36,527 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/d54fe52bba0146fca31ce32b2e04520a to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f1/d54fe52bba0146fca31ce32b2e04520a 2023-02-18 10:01:36,527 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/bb03af14e6d4f71cedbf1352904daaa6 2023-02-18 10:01:36,527 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:36,529 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/9dddd8ad05c4491e9c664ab1beeee066 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f1/9dddd8ad05c4491e9c664ab1beeee066 2023-02-18 10:01:36,530 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/b6bb805353244913acd61b8b0dbb600c to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/b6bb805353244913acd61b8b0dbb600c 2023-02-18 10:01:36,530 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/88f5bc9e95204a3d9168e22d15574c7e to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/88f5bc9e95204a3d9168e22d15574c7e 2023-02-18 10:01:36,531 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/recovered.edits] 2023-02-18 10:01:36,531 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/71ffefc9a44a42ed8e88072a2e71e7dc to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/71ffefc9a44a42ed8e88072a2e71e7dc 2023-02-18 10:01:36,532 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/4848d5a820d7423c9011612329b47718 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/4848d5a820d7423c9011612329b47718 2023-02-18 10:01:36,532 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/85680bbb62594d5abcf41250401bc161 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/85680bbb62594d5abcf41250401bc161 2023-02-18 10:01:36,533 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/96483022078a4cb8bd87b4121ff25d58 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/f2/96483022078a4cb8bd87b4121ff25d58 2023-02-18 10:01:36,533 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/a620f561dc864820815f2d5e57974829 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/f2/a620f561dc864820815f2d5e57974829 2023-02-18 10:01:36,533 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/1fa98bfa79694821b30eec2e4a22c5c6 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/1fa98bfa79694821b30eec2e4a22c5c6 2023-02-18 10:01:36,534 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/faa424384b734e399eeecccb46c839c7 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/f2/faa424384b734e399eeecccb46c839c7 2023-02-18 10:01:36,535 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/f2/e322b66f1c3c4f5f929f4b6c0dd1dc99 2023-02-18 10:01:36,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/1f802ac491d34277a80c1f69aacbe51b to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/1f802ac491d34277a80c1f69aacbe51b 2023-02-18 10:01:36,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/f7f8f94839c84cd0a1c80db32f09eac2 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/f2/f7f8f94839c84cd0a1c80db32f09eac2 2023-02-18 10:01:36,541 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/4ea78903583342c1a36ac35437101fb3 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/f2/4ea78903583342c1a36ac35437101fb3 2023-02-18 10:01:36,541 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/851d561a23644721b5c30f8316956bad to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/f2/851d561a23644721b5c30f8316956bad 2023-02-18 10:01:36,542 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/165e1a622a8d4ff2a9d7f7a16c042995 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/165e1a622a8d4ff2a9d7f7a16c042995 2023-02-18 10:01:36,543 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25/recovered.edits/12.seqid 2023-02-18 10:01:36,543 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb/recovered.edits/12.seqid 2023-02-18 10:01:36,543 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e/recovered.edits/12.seqid 2023-02-18 10:01:36,544 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/12749c25940e67ee9c6ce245df355f25 2023-02-18 10:01:36,544 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:36,545 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c/recovered.edits/12.seqid 2023-02-18 10:01:36,545 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/2679b8d9e9da1364429364a1903545eb 2023-02-18 10:01:36,545 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/898d85681b70eb3f586fde99e89fc87e 2023-02-18 10:01:36,546 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/b45c94ec7536709f058e2614dccba48c 2023-02-18 10:01:36,546 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/8053101b9deb4708b433af95059f9a2c to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f1/8053101b9deb4708b433af95059f9a2c 2023-02-18 10:01:36,546 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251/recovered.edits/12.seqid 2023-02-18 10:01:36,547 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdec22565c7839cc2851d97972b77251 2023-02-18 10:01:36,548 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f1, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/f2, FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/recovered.edits] 2023-02-18 10:01:36,548 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b/recovered.edits/12.seqid 2023-02-18 10:01:36,548 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5/recovered.edits/12.seqid 2023-02-18 10:01:36,548 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/0d9ae64f235b670d99a3455fc5d7523b 2023-02-18 10:01:36,549 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/8a75cd8168eb6271eebb583b01391eb5 2023-02-18 10:01:36,550 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/34ddd28b5368442b80b1ab1b462c6961 to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/34ddd28b5368442b80b1ab1b462c6961 2023-02-18 10:01:36,551 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/d5ea33b000844df484faffc85eae4ddf to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/f2/d5ea33b000844df484faffc85eae4ddf 2023-02-18 10:01:36,553 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/recovered.edits/6.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d/recovered.edits/6.seqid 2023-02-18 10:01:36,554 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/48c8fe525a719aa3c4c0e490bee0816d 2023-02-18 10:01:36,554 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/recovered.edits/12.seqid to hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/archive/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9/recovered.edits/12.seqid 2023-02-18 10:01:36,555 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ef94a556e6018271369424f1163fe9 2023-02-18 10:01:36,555 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-18 10:01:36,557 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,559 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-18 10:01:36,561 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714496562"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,564 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-18 10:01:36,564 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bb03af14e6d4f71cedbf1352904daaa6, NAME => 'testWithMockedMapReduceMultiRegion,,1676714492114.bb03af14e6d4f71cedbf1352904daaa6.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 8a75cd8168eb6271eebb583b01391eb5, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676714492114.8a75cd8168eb6271eebb583b01391eb5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 12749c25940e67ee9c6ce245df355f25, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676714492114.12749c25940e67ee9c6ce245df355f25.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 2679b8d9e9da1364429364a1903545eb, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676714492114.2679b8d9e9da1364429364a1903545eb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 0d9ae64f235b670d99a3455fc5d7523b, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676714492114.0d9ae64f235b670d99a3455fc5d7523b.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 898d85681b70eb3f586fde99e89fc87e, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676714492114.898d85681b70eb3f586fde99e89fc87e.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => b45c94ec7536709f058e2614dccba48c, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676714492114.b45c94ec7536709f058e2614dccba48c.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => fdec22565c7839cc2851d97972b77251, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676714492114.fdec22565c7839cc2851d97972b77251.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 87ef94a556e6018271369424f1163fe9, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676714492114.87ef94a556e6018271369424f1163fe9.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 48c8fe525a719aa3c4c0e490bee0816d, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676714492114.48c8fe525a719aa3c4c0e490bee0816d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-18 10:01:36,564 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-18 10:01:36,564 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676714496564"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:36,565 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-18 10:01:36,567 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 10:01:36,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 71 msec 2023-02-18 10:01:36,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45185] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 10:01:36,601 INFO [Listener at localhost/33455] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-18 10:01:36,601 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:36,601 INFO [Listener at localhost/33455] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:36,601 DEBUG [Listener at localhost/33455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0345809d to 127.0.0.1:53471 2023-02-18 10:01:36,601 DEBUG [Listener at localhost/33455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,601 DEBUG [Listener at localhost/33455] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:36,601 DEBUG [Listener at localhost/33455] util.JVMClusterUtil(257): Found active master hash=1126529739, stopped=false 2023-02-18 10:01:36,601 INFO [Listener at localhost/33455] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:36,603 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:36,603 INFO [Listener at localhost/33455] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:36,603 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:36,603 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:36,604 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:36,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:36,605 DEBUG [Listener at localhost/33455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71f772f0 to 127.0.0.1:53471 2023-02-18 10:01:36,605 DEBUG [Listener at localhost/33455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:36,605 INFO [Listener at localhost/33455] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33661,1676714490841' ***** 2023-02-18 10:01:36,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:36,605 INFO [Listener at localhost/33455] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:36,605 INFO [Listener at localhost/33455] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42779,1676714490874' ***** 2023-02-18 10:01:36,605 INFO [Listener at localhost/33455] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:36,605 INFO [RS:0;jenkins-hbase4:33661] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:36,605 INFO [RS:1;jenkins-hbase4:42779] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:36,605 INFO [RS:0;jenkins-hbase4:33661] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:36,606 INFO [RS:1;jenkins-hbase4:42779] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:36,605 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:36,606 INFO [RS:1;jenkins-hbase4:42779] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:36,606 INFO [RS:0;jenkins-hbase4:33661] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:36,607 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,607 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(3304): Received CLOSE for 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:36,607 DEBUG [RS:1;jenkins-hbase4:42779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d8284d0 to 127.0.0.1:53471 2023-02-18 10:01:36,606 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:36,607 DEBUG [RS:1;jenkins-hbase4:42779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6bd00dbd9248f114ac4988758023db91, disabling compactions & flushes 2023-02-18 10:01:36,607 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:36,608 DEBUG [RS:0;jenkins-hbase4:33661] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60296a1f to 127.0.0.1:53471 2023-02-18 10:01:36,608 INFO [RS:1;jenkins-hbase4:42779] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:36,608 INFO [RS:1;jenkins-hbase4:42779] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:36,608 INFO [RS:1;jenkins-hbase4:42779] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:36,608 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:36,608 DEBUG [RS:0;jenkins-hbase4:33661] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:36,608 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 10:01:36,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. after waiting 0 ms 2023-02-18 10:01:36,608 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1479): Online Regions={6bd00dbd9248f114ac4988758023db91=hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91.} 2023-02-18 10:01:36,608 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 10:01:36,608 DEBUG [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1505): Waiting on 6bd00dbd9248f114ac4988758023db91 2023-02-18 10:01:36,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:36,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:36,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:36,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6bd00dbd9248f114ac4988758023db91 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:36,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:36,610 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 10:01:36,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:36,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:36,610 DEBUG [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 10:01:36,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-18 10:01:36,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/.tmp/info/ee2704f7331043748530eb3fb14b5cce 2023-02-18 10:01:36,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/.tmp/info/d5e4d86707df4f48b71e06a36e3a4b16 2023-02-18 10:01:36,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/.tmp/info/ee2704f7331043748530eb3fb14b5cce as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/info/ee2704f7331043748530eb3fb14b5cce 2023-02-18 10:01:36,630 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5e4d86707df4f48b71e06a36e3a4b16 2023-02-18 10:01:36,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/info/ee2704f7331043748530eb3fb14b5cce, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:36,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6bd00dbd9248f114ac4988758023db91 in 23ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:36,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/namespace/6bd00dbd9248f114ac4988758023db91/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:36,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/.tmp/rep_barrier/f0ea91d2e6f6419ea6b21e6862372419 2023-02-18 10:01:36,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:36,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6bd00dbd9248f114ac4988758023db91: 2023-02-18 10:01:36,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714491537.6bd00dbd9248f114ac4988758023db91. 2023-02-18 10:01:36,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0ea91d2e6f6419ea6b21e6862372419 2023-02-18 10:01:36,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/.tmp/table/31ea7474bb934d35a8fefd06a3bbd725 2023-02-18 10:01:36,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31ea7474bb934d35a8fefd06a3bbd725 2023-02-18 10:01:36,655 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/.tmp/info/d5e4d86707df4f48b71e06a36e3a4b16 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/info/d5e4d86707df4f48b71e06a36e3a4b16 2023-02-18 10:01:36,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5e4d86707df4f48b71e06a36e3a4b16 2023-02-18 10:01:36,658 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/info/d5e4d86707df4f48b71e06a36e3a4b16, entries=30, sequenceid=57, filesize=8.3 K 2023-02-18 10:01:36,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/.tmp/rep_barrier/f0ea91d2e6f6419ea6b21e6862372419 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/rep_barrier/f0ea91d2e6f6419ea6b21e6862372419 2023-02-18 10:01:36,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0ea91d2e6f6419ea6b21e6862372419 2023-02-18 10:01:36,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/rep_barrier/f0ea91d2e6f6419ea6b21e6862372419, entries=10, sequenceid=57, filesize=6.1 K 2023-02-18 10:01:36,663 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/.tmp/table/31ea7474bb934d35a8fefd06a3bbd725 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/table/31ea7474bb934d35a8fefd06a3bbd725 2023-02-18 10:01:36,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31ea7474bb934d35a8fefd06a3bbd725 2023-02-18 10:01:36,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/table/31ea7474bb934d35a8fefd06a3bbd725, entries=13, sequenceid=57, filesize=6.1 K 2023-02-18 10:01:36,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=57, compaction requested=false 2023-02-18 10:01:36,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-18 10:01:36,672 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:36,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:36,673 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:36,673 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:36,675 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:36,690 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:36,810 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33661,1676714490841; all regions closed. 2023-02-18 10:01:36,811 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42779,1676714490874; all regions closed. 2023-02-18 10:01:36,818 DEBUG [RS:0;jenkins-hbase4:33661] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/oldWALs 2023-02-18 10:01:36,818 INFO [RS:0;jenkins-hbase4:33661] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33661%2C1676714490841:(num 1676714491938) 2023-02-18 10:01:36,818 DEBUG [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/oldWALs 2023-02-18 10:01:36,818 DEBUG [RS:0;jenkins-hbase4:33661] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,818 INFO [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42779%2C1676714490874.meta:.meta(num 1676714491461) 2023-02-18 10:01:36,818 INFO [RS:0;jenkins-hbase4:33661] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:36,819 INFO [RS:0;jenkins-hbase4:33661] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:36,819 INFO [RS:0;jenkins-hbase4:33661] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:36,819 INFO [RS:0;jenkins-hbase4:33661] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:36,819 INFO [RS:0;jenkins-hbase4:33661] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:36,819 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:36,820 INFO [RS:0;jenkins-hbase4:33661] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33661 2023-02-18 10:01:36,821 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,822 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33661,1676714490841 2023-02-18 10:01:36,822 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:36,822 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@511e29e5 rejected from java.util.concurrent.ThreadPoolExecutor@5521b71e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:36,821 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:36,822 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:36,822 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@188a718 rejected from java.util.concurrent.ThreadPoolExecutor@5521b71e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:36,823 DEBUG [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/oldWALs 2023-02-18 10:01:36,823 INFO [RS:1;jenkins-hbase4:42779] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42779%2C1676714490874:(num 1676714492325) 2023-02-18 10:01:36,823 DEBUG [RS:1;jenkins-hbase4:42779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,823 INFO [RS:1;jenkins-hbase4:42779] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:36,823 INFO [RS:1;jenkins-hbase4:42779] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:36,823 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33661,1676714490841] 2023-02-18 10:01:36,823 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33661,1676714490841; numProcessing=1 2023-02-18 10:01:36,823 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:36,824 INFO [RS:1;jenkins-hbase4:42779] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42779 2023-02-18 10:01:36,825 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33661,1676714490841 already deleted, retry=false 2023-02-18 10:01:36,825 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33661,1676714490841 expired; onlineServers=1 2023-02-18 10:01:36,826 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42779,1676714490874 2023-02-18 10:01:36,826 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:36,826 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a7bc83 rejected from java.util.concurrent.ThreadPoolExecutor@498384f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:36,826 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42779,1676714490874] 2023-02-18 10:01:36,827 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42779,1676714490874; numProcessing=2 2023-02-18 10:01:36,828 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42779,1676714490874 already deleted, retry=false 2023-02-18 10:01:36,828 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42779,1676714490874 expired; onlineServers=0 2023-02-18 10:01:36,829 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45185,1676714490755' ***** 2023-02-18 10:01:36,829 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:36,829 DEBUG [M:0;jenkins-hbase4:45185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@471ae677, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:36,829 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45185,1676714490755 2023-02-18 10:01:36,829 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45185,1676714490755; all regions closed. 2023-02-18 10:01:36,829 DEBUG [M:0;jenkins-hbase4:45185] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:36,829 DEBUG [M:0;jenkins-hbase4:45185] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:36,829 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:36,829 DEBUG [M:0;jenkins-hbase4:45185] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:36,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714491028] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714491028,5,FailOnTimeoutGroup] 2023-02-18 10:01:36,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714491028] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714491028,5,FailOnTimeoutGroup] 2023-02-18 10:01:36,830 INFO [M:0;jenkins-hbase4:45185] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:36,831 INFO [M:0;jenkins-hbase4:45185] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:36,831 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:36,831 INFO [M:0;jenkins-hbase4:45185] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:36,831 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:36,831 DEBUG [M:0;jenkins-hbase4:45185] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:36,831 INFO [M:0;jenkins-hbase4:45185] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:36,831 ERROR [M:0;jenkins-hbase4:45185] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 10:01:36,832 INFO [M:0;jenkins-hbase4:45185] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:36,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:36,832 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:36,832 DEBUG [M:0;jenkins-hbase4:45185] zookeeper.ZKUtil(398): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:36,832 WARN [M:0;jenkins-hbase4:45185] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:36,832 INFO [M:0;jenkins-hbase4:45185] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:36,833 INFO [M:0;jenkins-hbase4:45185] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:36,833 DEBUG [M:0;jenkins-hbase4:45185] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:36,833 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:36,833 DEBUG [M:0;jenkins-hbase4:45185] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:36,833 DEBUG [M:0;jenkins-hbase4:45185] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:36,833 DEBUG [M:0;jenkins-hbase4:45185] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:36,833 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.16 KB heapSize=200.04 KB 2023-02-18 10:01:36,841 INFO [M:0;jenkins-hbase4:45185] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.16 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d5b09e42066a48deb99e187266805468 2023-02-18 10:01:36,845 DEBUG [M:0;jenkins-hbase4:45185] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d5b09e42066a48deb99e187266805468 as hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d5b09e42066a48deb99e187266805468 2023-02-18 10:01:36,849 INFO [M:0;jenkins-hbase4:45185] regionserver.HStore(1080): Added hdfs://localhost:44109/user/jenkins/test-data/0f2465fc-e19e-dc3a-0f1b-eeb9e20f12fa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d5b09e42066a48deb99e187266805468, entries=53, sequenceid=357, filesize=10.7 K 2023-02-18 10:01:36,849 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegion(2947): Finished flush of dataSize ~167.16 KB/171173, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-18 10:01:36,850 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:36,850 DEBUG [M:0;jenkins-hbase4:45185] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:36,852 INFO [M:0;jenkins-hbase4:45185] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:36,852 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:36,853 INFO [M:0;jenkins-hbase4:45185] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45185 2023-02-18 10:01:36,855 DEBUG [M:0;jenkins-hbase4:45185] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45185,1676714490755 already deleted, retry=false 2023-02-18 10:01:37,103 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:37,103 INFO [M:0;jenkins-hbase4:45185] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45185,1676714490755; zookeeper connection closed. 2023-02-18 10:01:37,103 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b96595 rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:37,104 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): master:45185-0x10066e0a52c0000, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:37,105 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3bd1147e rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:37,203 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:37,203 INFO [RS:1;jenkins-hbase4:42779] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42779,1676714490874; zookeeper connection closed. 2023-02-18 10:01:37,204 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4defec1f rejected from java.util.concurrent.ThreadPoolExecutor@498384f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:37,204 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:42779-0x10066e0a52c0002, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:37,204 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@350e1698 rejected from java.util.concurrent.ThreadPoolExecutor@498384f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:37,204 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@425ade56] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@425ade56 2023-02-18 10:01:37,304 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:37,304 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79b82dab rejected from java.util.concurrent.ThreadPoolExecutor@5521b71e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:37,304 DEBUG [Listener at localhost/33455-EventThread] zookeeper.ZKWatcher(600): regionserver:33661-0x10066e0a52c0001, quorum=127.0.0.1:53471, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:37,304 ERROR [Listener at localhost/33455-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34f805ef rejected from java.util.concurrent.ThreadPoolExecutor@5521b71e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:37,304 INFO [RS:0;jenkins-hbase4:33661] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33661,1676714490841; zookeeper connection closed. 2023-02-18 10:01:37,311 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@12d5819] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@12d5819 2023-02-18 10:01:37,311 INFO [Listener at localhost/33455] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:37,311 WARN [Listener at localhost/33455] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:37,315 INFO [Listener at localhost/33455] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:37,422 WARN [BP-2042315164-172.31.14.131-1676714490044 heartbeating to localhost/127.0.0.1:44109] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:37,422 WARN [BP-2042315164-172.31.14.131-1676714490044 heartbeating to localhost/127.0.0.1:44109] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2042315164-172.31.14.131-1676714490044 (Datanode Uuid 8ec2fec5-c038-4002-9b28-339de15aba0a) service to localhost/127.0.0.1:44109 2023-02-18 10:01:37,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/dfs/data/data3/current/BP-2042315164-172.31.14.131-1676714490044] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:37,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/dfs/data/data4/current/BP-2042315164-172.31.14.131-1676714490044] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:37,424 WARN [Listener at localhost/33455] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:37,427 INFO [Listener at localhost/33455] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:37,531 WARN [BP-2042315164-172.31.14.131-1676714490044 heartbeating to localhost/127.0.0.1:44109] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:37,532 WARN [BP-2042315164-172.31.14.131-1676714490044 heartbeating to localhost/127.0.0.1:44109] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2042315164-172.31.14.131-1676714490044 (Datanode Uuid ff54ade0-579c-4b09-9904-e7fc65c3c984) service to localhost/127.0.0.1:44109 2023-02-18 10:01:37,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/dfs/data/data1/current/BP-2042315164-172.31.14.131-1676714490044] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:37,536 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/cluster_6f8ec1b7-584b-7ebe-e08e-68c521284bba/dfs/data/data2/current/BP-2042315164-172.31.14.131-1676714490044] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:37,545 INFO [Listener at localhost/33455] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:37,664 INFO [Listener at localhost/33455] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:37,701 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:37,715 INFO [Listener at localhost/33455] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=227 (was 176) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44109 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33455 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44109 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,45185,1676714490755)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44109 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44109 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:44109 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:44109 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33455.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:44109 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=631 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 244), ProcessCount=170 (was 172), AvailableMemoryMB=8662 (was 8810) 2023-02-18 10:01:37,725 INFO [Listener at localhost/33455] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=227, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=170, AvailableMemoryMB=8662 2023-02-18 10:01:37,735 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/hadoop.log.dir so I do NOT create it in target/test-data/f23607ce-61a0-4412-070c-a8aef174613b 2023-02-18 10:01:37,735 WARN [Listener at localhost/33455] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 10:01:37,735 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/hadoop.tmp.dir so I do NOT create it in target/test-data/f23607ce-61a0-4412-070c-a8aef174613b 2023-02-18 10:01:37,735 WARN [Listener at localhost/33455] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7ce89670-54b9-ef62-82ad-750f3b1cfe9e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 10:01:37,735 DEBUG [Listener at localhost/33455] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40, deleteOnExit=true 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/test.cache.data in system properties and HBase conf 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:01:37,736 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:01:37,737 DEBUG [Listener at localhost/33455] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:37,737 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:01:37,738 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:01:37,738 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:01:37,738 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:37,738 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:01:37,738 INFO [Listener at localhost/33455] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:01:37,742 WARN [Listener at localhost/33455] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:37,742 WARN [Listener at localhost/33455] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:37,778 WARN [Listener at localhost/33455] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:37,781 INFO [Listener at localhost/33455] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:37,798 INFO [Listener at localhost/33455] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/java.io.tmpdir/Jetty_localhost_39767_hdfs____.czwpc4/webapp 2023-02-18 10:01:37,897 INFO [Listener at localhost/33455] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39767 2023-02-18 10:01:37,902 WARN [Listener at localhost/33455] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:37,903 WARN [Listener at localhost/33455] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:37,957 WARN [Listener at localhost/45223] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:37,973 WARN [Listener at localhost/45223] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:37,976 WARN [Listener at localhost/45223] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:37,977 INFO [Listener at localhost/45223] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:37,983 INFO [Listener at localhost/45223] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/java.io.tmpdir/Jetty_localhost_38205_datanode____jufn6h/webapp 2023-02-18 10:01:38,074 INFO [Listener at localhost/45223] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38205 2023-02-18 10:01:38,084 WARN [Listener at localhost/37733] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:38,102 WARN [Listener at localhost/37733] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:38,104 WARN [Listener at localhost/37733] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:38,105 INFO [Listener at localhost/37733] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:38,108 INFO [Listener at localhost/37733] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/java.io.tmpdir/Jetty_localhost_39125_datanode____.u92ozv/webapp 2023-02-18 10:01:38,198 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89626bbda7c0e81a: Processing first storage report for DS-e32642c6-d2a4-4d20-857f-d9161e553e6b from datanode 51643de5-151a-432e-a42b-bd3aed66fa09 2023-02-18 10:01:38,198 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89626bbda7c0e81a: from storage DS-e32642c6-d2a4-4d20-857f-d9161e553e6b node DatanodeRegistration(127.0.0.1:37079, datanodeUuid=51643de5-151a-432e-a42b-bd3aed66fa09, infoPort=42189, infoSecurePort=0, ipcPort=37733, storageInfo=lv=-57;cid=testClusterID;nsid=554590197;c=1676714497744), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:38,198 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89626bbda7c0e81a: Processing first storage report for DS-2f9e5a6c-d2a1-4d12-b5fc-50304d497aec from datanode 51643de5-151a-432e-a42b-bd3aed66fa09 2023-02-18 10:01:38,198 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89626bbda7c0e81a: from storage DS-2f9e5a6c-d2a1-4d12-b5fc-50304d497aec node DatanodeRegistration(127.0.0.1:37079, datanodeUuid=51643de5-151a-432e-a42b-bd3aed66fa09, infoPort=42189, infoSecurePort=0, ipcPort=37733, storageInfo=lv=-57;cid=testClusterID;nsid=554590197;c=1676714497744), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:38,218 INFO [Listener at localhost/37733] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39125 2023-02-18 10:01:38,227 WARN [Listener at localhost/36611] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:38,336 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3996d07ad1a544af: Processing first storage report for DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f from datanode ea12563c-bb5f-49f5-9d12-a4ab9fa41f35 2023-02-18 10:01:38,336 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3996d07ad1a544af: from storage DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f node DatanodeRegistration(127.0.0.1:41119, datanodeUuid=ea12563c-bb5f-49f5-9d12-a4ab9fa41f35, infoPort=39461, infoSecurePort=0, ipcPort=36611, storageInfo=lv=-57;cid=testClusterID;nsid=554590197;c=1676714497744), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:38,336 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3996d07ad1a544af: Processing first storage report for DS-b6191f21-4c55-4746-b642-bb2fabce6345 from datanode ea12563c-bb5f-49f5-9d12-a4ab9fa41f35 2023-02-18 10:01:38,336 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3996d07ad1a544af: from storage DS-b6191f21-4c55-4746-b642-bb2fabce6345 node DatanodeRegistration(127.0.0.1:41119, datanodeUuid=ea12563c-bb5f-49f5-9d12-a4ab9fa41f35, infoPort=39461, infoSecurePort=0, ipcPort=36611, storageInfo=lv=-57;cid=testClusterID;nsid=554590197;c=1676714497744), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:38,434 DEBUG [Listener at localhost/36611] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b 2023-02-18 10:01:38,437 INFO [Listener at localhost/36611] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/zookeeper_0, clientPort=60232, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:01:38,437 INFO [Listener at localhost/36611] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60232 2023-02-18 10:01:38,438 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,438 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,449 INFO [Listener at localhost/36611] util.FSUtils(479): Created version file at hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d with version=8 2023-02-18 10:01:38,450 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,450 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,451 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/hbase-staging 2023-02-18 10:01:38,453 INFO [Listener at localhost/36611] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:38,453 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,453 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,453 INFO [Listener at localhost/36611] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:38,454 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,454 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:38,454 INFO [Listener at localhost/36611] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:38,454 INFO [Listener at localhost/36611] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39073 2023-02-18 10:01:38,455 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,456 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,457 INFO [Listener at localhost/36611] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39073 connecting to ZooKeeper ensemble=127.0.0.1:60232 2023-02-18 10:01:38,465 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:390730x0, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:38,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39073-0x10066e0c3490000 connected 2023-02-18 10:01:38,479 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:38,480 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:38,480 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:38,481 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39073 2023-02-18 10:01:38,481 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39073 2023-02-18 10:01:38,483 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39073 2023-02-18 10:01:38,484 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39073 2023-02-18 10:01:38,484 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39073 2023-02-18 10:01:38,484 INFO [Listener at localhost/36611] master.HMaster(444): hbase.rootdir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d, hbase.cluster.distributed=false 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:38,498 INFO [Listener at localhost/36611] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:38,499 INFO [Listener at localhost/36611] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46059 2023-02-18 10:01:38,499 INFO [Listener at localhost/36611] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:38,502 DEBUG [Listener at localhost/36611] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:38,502 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,503 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,504 INFO [Listener at localhost/36611] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46059 connecting to ZooKeeper ensemble=127.0.0.1:60232 2023-02-18 10:01:38,507 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:460590x0, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:38,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46059-0x10066e0c3490001 connected 2023-02-18 10:01:38,512 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:38,514 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:38,515 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:38,515 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46059 2023-02-18 10:01:38,516 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46059 2023-02-18 10:01:38,516 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46059 2023-02-18 10:01:38,516 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46059 2023-02-18 10:01:38,517 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46059 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:38,528 INFO [Listener at localhost/36611] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:38,529 INFO [Listener at localhost/36611] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44093 2023-02-18 10:01:38,529 INFO [Listener at localhost/36611] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:38,530 DEBUG [Listener at localhost/36611] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:38,531 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,531 INFO [Listener at localhost/36611] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,532 INFO [Listener at localhost/36611] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44093 connecting to ZooKeeper ensemble=127.0.0.1:60232 2023-02-18 10:01:38,535 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:440930x0, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:38,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44093-0x10066e0c3490002 connected 2023-02-18 10:01:38,537 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:38,537 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:38,538 DEBUG [Listener at localhost/36611] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:38,538 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44093 2023-02-18 10:01:38,538 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44093 2023-02-18 10:01:38,538 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44093 2023-02-18 10:01:38,539 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44093 2023-02-18 10:01:38,539 DEBUG [Listener at localhost/36611] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44093 2023-02-18 10:01:38,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,541 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:38,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,544 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:38,544 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:38,544 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,544 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:38,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:38,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39073,1676714498453 from backup master directory 2023-02-18 10:01:38,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:38,548 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,548 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:38,548 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:38,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/hbase.id with ID: d5037fbf-1c8e-41d3-bbf2-ae6faede787a 2023-02-18 10:01:38,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:38,566 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x44c8ef49 to 127.0.0.1:60232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:38,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@255f1c70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:38,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:38,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:38,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:38,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store-tmp 2023-02-18 10:01:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:38,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:38,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:38,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/WALs/jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39073%2C1676714498453, suffix=, logDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/WALs/jenkins-hbase4.apache.org,39073,1676714498453, archiveDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:38,597 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK] 2023-02-18 10:01:38,597 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK] 2023-02-18 10:01:38,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/WALs/jenkins-hbase4.apache.org,39073,1676714498453/jenkins-hbase4.apache.org%2C39073%2C1676714498453.1676714498584 2023-02-18 10:01:38,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK]] 2023-02-18 10:01:38,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:38,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:38,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:38,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:38,602 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:38,603 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:38,603 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:38,603 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:38,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:38,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:38,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:38,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:38,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74732908, jitterRate=0.11360710859298706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:38,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:38,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:38,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:38,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:38,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:38,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 10:01:38,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 10:01:38,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:38,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:38,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:38,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:38,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:38,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:38,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:38,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:38,625 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:38,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:38,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:38,627 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:38,627 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:38,627 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,627 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:38,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39073,1676714498453, sessionid=0x10066e0c3490000, setting cluster-up flag (Was=false) 2023-02-18 10:01:38,632 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:38,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,645 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:38,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:38,649 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.hbase-snapshot/.tmp 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:38,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714528652 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:38,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,653 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:38,653 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:38,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:38,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:38,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:38,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:38,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:38,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714498654,5,FailOnTimeoutGroup] 2023-02-18 10:01:38,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714498654,5,FailOnTimeoutGroup] 2023-02-18 10:01:38,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:38,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,654 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:38,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,660 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:38,661 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:38,661 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d 2023-02-18 10:01:38,666 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:38,667 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:38,668 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/info 2023-02-18 10:01:38,668 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:38,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:38,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:38,670 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:38,670 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:38,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:38,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:38,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/table 2023-02-18 10:01:38,672 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:38,673 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:38,673 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740 2023-02-18 10:01:38,674 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740 2023-02-18 10:01:38,675 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:38,677 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:38,678 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:38,679 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59437657, jitterRate=-0.1143098920583725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:38,679 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:38,679 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:38,679 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:38,679 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:38,679 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:38,679 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:38,679 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:38,680 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:38,680 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:38,680 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:38,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:38,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:38,683 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:38,741 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(952): ClusterId : d5037fbf-1c8e-41d3-bbf2-ae6faede787a 2023-02-18 10:01:38,741 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(952): ClusterId : d5037fbf-1c8e-41d3-bbf2-ae6faede787a 2023-02-18 10:01:38,741 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:38,741 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:38,744 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:38,744 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:38,744 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:38,744 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:38,745 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:38,747 DEBUG [RS:0;jenkins-hbase4:46059] zookeeper.ReadOnlyZKClient(139): Connect 0x7643d350 to 127.0.0.1:60232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:38,747 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:38,748 DEBUG [RS:1;jenkins-hbase4:44093] zookeeper.ReadOnlyZKClient(139): Connect 0x42f0c0a2 to 127.0.0.1:60232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:38,756 DEBUG [RS:0;jenkins-hbase4:46059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788433e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:38,756 DEBUG [RS:0;jenkins-hbase4:46059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cbbb820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:38,756 DEBUG [RS:1;jenkins-hbase4:44093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c37268c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:38,756 DEBUG [RS:1;jenkins-hbase4:44093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4808abd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:38,764 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46059 2023-02-18 10:01:38,764 INFO [RS:0;jenkins-hbase4:46059] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:38,764 INFO [RS:0;jenkins-hbase4:46059] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:38,764 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:38,764 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44093 2023-02-18 10:01:38,764 INFO [RS:1;jenkins-hbase4:44093] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:38,764 INFO [RS:1;jenkins-hbase4:44093] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:38,764 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:38,764 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39073,1676714498453 with isa=jenkins-hbase4.apache.org/172.31.14.131:46059, startcode=1676714498497 2023-02-18 10:01:38,764 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39073,1676714498453 with isa=jenkins-hbase4.apache.org/172.31.14.131:44093, startcode=1676714498527 2023-02-18 10:01:38,765 DEBUG [RS:0;jenkins-hbase4:46059] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:38,765 DEBUG [RS:1;jenkins-hbase4:44093] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:38,766 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58907, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:38,766 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51963, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:38,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39073] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,768 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,768 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d 2023-02-18 10:01:38,768 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d 2023-02-18 10:01:38,768 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45223 2023-02-18 10:01:38,768 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45223 2023-02-18 10:01:38,769 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:38,768 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:38,773 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:38,773 DEBUG [RS:0;jenkins-hbase4:46059] zookeeper.ZKUtil(162): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,773 DEBUG [RS:1;jenkins-hbase4:44093] zookeeper.ZKUtil(162): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,773 WARN [RS:0;jenkins-hbase4:46059] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:38,773 WARN [RS:1;jenkins-hbase4:44093] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:38,773 INFO [RS:0;jenkins-hbase4:46059] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:38,774 INFO [RS:1;jenkins-hbase4:44093] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:38,774 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,774 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,774 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46059,1676714498497] 2023-02-18 10:01:38,774 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44093,1676714498527] 2023-02-18 10:01:38,779 DEBUG [RS:1;jenkins-hbase4:44093] zookeeper.ZKUtil(162): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,779 DEBUG [RS:0;jenkins-hbase4:46059] zookeeper.ZKUtil(162): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,780 DEBUG [RS:1;jenkins-hbase4:44093] zookeeper.ZKUtil(162): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,780 DEBUG [RS:0;jenkins-hbase4:46059] zookeeper.ZKUtil(162): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,780 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:38,780 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:38,781 INFO [RS:1;jenkins-hbase4:44093] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:38,781 INFO [RS:0;jenkins-hbase4:46059] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:38,782 INFO [RS:1;jenkins-hbase4:44093] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:38,782 INFO [RS:1;jenkins-hbase4:44093] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:38,782 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,782 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:38,783 INFO [RS:0;jenkins-hbase4:46059] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:38,783 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,783 INFO [RS:0;jenkins-hbase4:46059] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:38,784 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,784 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,784 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,784 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,784 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:38,784 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,785 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,785 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:38,785 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,785 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,785 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,785 DEBUG [RS:1;jenkins-hbase4:44093] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,785 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,785 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,786 DEBUG [RS:0;jenkins-hbase4:46059] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:38,789 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,789 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,789 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,797 INFO [RS:1;jenkins-hbase4:44093] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:38,797 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44093,1676714498527-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,798 INFO [RS:0;jenkins-hbase4:46059] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:38,798 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46059,1676714498497-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:38,807 INFO [RS:1;jenkins-hbase4:44093] regionserver.Replication(203): jenkins-hbase4.apache.org,44093,1676714498527 started 2023-02-18 10:01:38,807 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44093,1676714498527, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44093, sessionid=0x10066e0c3490002 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44093,1676714498527' 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:38,807 DEBUG [RS:1;jenkins-hbase4:44093] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:38,808 DEBUG [RS:1;jenkins-hbase4:44093] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44093,1676714498527' 2023-02-18 10:01:38,808 DEBUG [RS:1;jenkins-hbase4:44093] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:38,808 DEBUG [RS:1;jenkins-hbase4:44093] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:38,808 INFO [RS:0;jenkins-hbase4:46059] regionserver.Replication(203): jenkins-hbase4.apache.org,46059,1676714498497 started 2023-02-18 10:01:38,808 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46059,1676714498497, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46059, sessionid=0x10066e0c3490001 2023-02-18 10:01:38,808 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:38,808 DEBUG [RS:1;jenkins-hbase4:44093] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:38,808 DEBUG [RS:0;jenkins-hbase4:46059] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,808 DEBUG [RS:0;jenkins-hbase4:46059] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46059,1676714498497' 2023-02-18 10:01:38,808 DEBUG [RS:0;jenkins-hbase4:46059] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:38,808 INFO [RS:1;jenkins-hbase4:44093] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:38,808 INFO [RS:1;jenkins-hbase4:44093] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:38,808 DEBUG [RS:0;jenkins-hbase4:46059] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46059,1676714498497' 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:38,809 DEBUG [RS:0;jenkins-hbase4:46059] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:38,809 INFO [RS:0;jenkins-hbase4:46059] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:38,809 INFO [RS:0;jenkins-hbase4:46059] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:38,834 DEBUG [jenkins-hbase4:39073] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:38,834 DEBUG [jenkins-hbase4:39073] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:38,835 DEBUG [jenkins-hbase4:39073] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:38,836 DEBUG [jenkins-hbase4:39073] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:38,836 DEBUG [jenkins-hbase4:39073] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:38,836 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46059,1676714498497, state=OPENING 2023-02-18 10:01:38,837 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:38,838 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:38,838 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:38,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46059,1676714498497}] 2023-02-18 10:01:38,995 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:38,995 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:38,997 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:39,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:39,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:39,003 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46059%2C1676714498497.meta, suffix=.meta, logDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,46059,1676714498497, archiveDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/oldWALs, maxLogs=32 2023-02-18 10:01:39,018 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK] 2023-02-18 10:01:39,018 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK] 2023-02-18 10:01:39,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,46059,1676714498497/jenkins-hbase4.apache.org%2C46059%2C1676714498497.meta.1676714499003.meta 2023-02-18 10:01:39,024 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK]] 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:39,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:39,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:39,027 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:39,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/info 2023-02-18 10:01:39,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/info 2023-02-18 10:01:39,028 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:39,029 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:39,029 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:39,029 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:39,030 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:39,030 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:39,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:39,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:39,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/table 2023-02-18 10:01:39,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/table 2023-02-18 10:01:39,032 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:39,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:39,033 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740 2023-02-18 10:01:39,035 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740 2023-02-18 10:01:39,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:39,038 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:39,039 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66839661, jitterRate=-0.004011437296867371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:39,039 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:39,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714498995 2023-02-18 10:01:39,045 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:39,046 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:39,046 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46059,1676714498497, state=OPEN 2023-02-18 10:01:39,053 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:39,053 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:39,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:39,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46059,1676714498497 in 215 msec 2023-02-18 10:01:39,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:39,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 376 msec 2023-02-18 10:01:39,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 409 msec 2023-02-18 10:01:39,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714499059, completionTime=-1 2023-02-18 10:01:39,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:39,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:39,063 DEBUG [hconnection-0x39bee54d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:39,068 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46358, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:39,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:39,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714559070 2023-02-18 10:01:39,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714619071 2023-02-18 10:01:39,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39073,1676714498453-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39073,1676714498453-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39073,1676714498453-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39073, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:39,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:39,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:39,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:39,085 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:39,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:39,087 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,087 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a empty. 2023-02-18 10:01:39,087 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:39,099 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:39,102 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fccb79980a4b65a7669486cb4acb161a, NAME => 'hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp 2023-02-18 10:01:39,116 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:39,116 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fccb79980a4b65a7669486cb4acb161a, disabling compactions & flushes 2023-02-18 10:01:39,116 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,116 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,116 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. after waiting 0 ms 2023-02-18 10:01:39,116 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,116 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,116 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fccb79980a4b65a7669486cb4acb161a: 2023-02-18 10:01:39,118 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:39,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714499119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714499119"}]},"ts":"1676714499119"} 2023-02-18 10:01:39,121 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:39,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:39,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714499122"}]},"ts":"1676714499122"} 2023-02-18 10:01:39,123 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:39,127 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:39,127 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:39,127 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:39,127 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:39,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fccb79980a4b65a7669486cb4acb161a, ASSIGN}] 2023-02-18 10:01:39,130 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fccb79980a4b65a7669486cb4acb161a, ASSIGN 2023-02-18 10:01:39,130 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fccb79980a4b65a7669486cb4acb161a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44093,1676714498527; forceNewPlan=false, retain=false 2023-02-18 10:01:39,281 INFO [jenkins-hbase4:39073] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:39,281 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fccb79980a4b65a7669486cb4acb161a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:39,281 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714499281"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714499281"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714499281"}]},"ts":"1676714499281"} 2023-02-18 10:01:39,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fccb79980a4b65a7669486cb4acb161a, server=jenkins-hbase4.apache.org,44093,1676714498527}] 2023-02-18 10:01:39,436 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:39,436 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:39,438 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42440, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:39,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,442 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44093%2C1676714498527, suffix=, logDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,44093,1676714498527, archiveDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/oldWALs, maxLogs=32 2023-02-18 10:01:39,461 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK] 2023-02-18 10:01:39,462 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK] 2023-02-18 10:01:39,463 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,44093,1676714498527/jenkins-hbase4.apache.org%2C44093%2C1676714498527.1676714499443 2023-02-18 10:01:39,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK], DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK]] 2023-02-18 10:01:39,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fccb79980a4b65a7669486cb4acb161a, NAME => 'hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:39,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:39,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,465 INFO [StoreOpener-fccb79980a4b65a7669486cb4acb161a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,467 DEBUG [StoreOpener-fccb79980a4b65a7669486cb4acb161a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/info 2023-02-18 10:01:39,467 DEBUG [StoreOpener-fccb79980a4b65a7669486cb4acb161a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/info 2023-02-18 10:01:39,467 INFO [StoreOpener-fccb79980a4b65a7669486cb4acb161a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fccb79980a4b65a7669486cb4acb161a columnFamilyName info 2023-02-18 10:01:39,468 INFO [StoreOpener-fccb79980a4b65a7669486cb4acb161a-1] regionserver.HStore(310): Store=fccb79980a4b65a7669486cb4acb161a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:39,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,471 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:39,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:39,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fccb79980a4b65a7669486cb4acb161a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68480731, jitterRate=0.020442411303520203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:39,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fccb79980a4b65a7669486cb4acb161a: 2023-02-18 10:01:39,474 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a., pid=6, masterSystemTime=1676714499436 2023-02-18 10:01:39,477 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,477 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:39,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fccb79980a4b65a7669486cb4acb161a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:39,478 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714499478"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714499478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714499478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714499478"}]},"ts":"1676714499478"} 2023-02-18 10:01:39,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:39,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fccb79980a4b65a7669486cb4acb161a, server=jenkins-hbase4.apache.org,44093,1676714498527 in 196 msec 2023-02-18 10:01:39,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:39,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fccb79980a4b65a7669486cb4acb161a, ASSIGN in 352 msec 2023-02-18 10:01:39,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:39,482 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714499482"}]},"ts":"1676714499482"} 2023-02-18 10:01:39,483 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:39,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:39,485 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:39,486 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:39,486 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:39,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 403 msec 2023-02-18 10:01:39,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:39,489 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42448, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:39,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:39,498 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:39,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-18 10:01:39,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:39,523 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:39,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-18 10:01:39,538 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:39,540 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:39,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.992sec 2023-02-18 10:01:39,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:39,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:39,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:39,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39073,1676714498453-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:39,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39073,1676714498453-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:39,542 DEBUG [Listener at localhost/36611] zookeeper.ReadOnlyZKClient(139): Connect 0x1d36c7f5 to 127.0.0.1:60232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:39,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:39,550 DEBUG [Listener at localhost/36611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c1800c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:39,551 DEBUG [hconnection-0x23bc2c65-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:39,553 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:39,554 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:39,554 DEBUG [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:39,556 DEBUG [Listener at localhost/36611] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:39,557 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:39,557 INFO [Listener at localhost/36611] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-18 10:01:39,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-18 10:01:39,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:39,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:50326 deadline: 1676714559558, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-18 10:01:39,558 INFO [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-18 10:01:39,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:39,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:39,562 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:39,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-18 10:01:39,562 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:39,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:39,564 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,564 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 empty. 2023-02-18 10:01:39,564 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,565 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-18 10:01:39,571 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:39,572 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 57c13274da9b4baefeab4052a90fda08, NAME => 'testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp 2023-02-18 10:01:39,577 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:39,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 57c13274da9b4baefeab4052a90fda08, disabling compactions & flushes 2023-02-18 10:01:39,578 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. after waiting 0 ms 2023-02-18 10:01:39,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,578 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,578 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:39,579 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:39,580 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676714499580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714499580"}]},"ts":"1676714499580"} 2023-02-18 10:01:39,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:39,582 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:39,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714499582"}]},"ts":"1676714499582"} 2023-02-18 10:01:39,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-18 10:01:39,586 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:39,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:39,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:39,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:39,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, ASSIGN}] 2023-02-18 10:01:39,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, ASSIGN 2023-02-18 10:01:39,589 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46059,1676714498497; forceNewPlan=false, retain=false 2023-02-18 10:01:39,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:39,740 INFO [jenkins-hbase4:39073] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:39,740 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=57c13274da9b4baefeab4052a90fda08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:39,740 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676714499740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714499740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714499740"}]},"ts":"1676714499740"} 2023-02-18 10:01:39,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 57c13274da9b4baefeab4052a90fda08, server=jenkins-hbase4.apache.org,46059,1676714498497}] 2023-02-18 10:01:39,811 INFO [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46059%2C1676714498497, suffix=, logDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,46059,1676714498497, archiveDir=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/oldWALs, maxLogs=32 2023-02-18 10:01:39,825 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK] 2023-02-18 10:01:39,825 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK] 2023-02-18 10:01:39,827 INFO [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/WALs/jenkins-hbase4.apache.org,46059,1676714498497/jenkins-hbase4.apache.org%2C46059%2C1676714498497.1676714499811 2023-02-18 10:01:39,827 DEBUG [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37079,DS-e32642c6-d2a4-4d20-857f-d9161e553e6b,DISK], DatanodeInfoWithStorage[127.0.0.1:41119,DS-f4e562c3-bdd2-4058-8e6d-bcb02127135f,DISK]] 2023-02-18 10:01:39,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:39,880 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:39,880 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-18 10:01:39,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 57c13274da9b4baefeab4052a90fda08, NAME => 'testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:39,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:39,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,898 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,899 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1 2023-02-18 10:01:39,899 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1 2023-02-18 10:01:39,899 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c13274da9b4baefeab4052a90fda08 columnFamilyName f1 2023-02-18 10:01:39,900 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(310): Store=57c13274da9b4baefeab4052a90fda08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:39,900 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,901 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2 2023-02-18 10:01:39,901 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2 2023-02-18 10:01:39,901 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c13274da9b4baefeab4052a90fda08 columnFamilyName f2 2023-02-18 10:01:39,902 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(310): Store=57c13274da9b4baefeab4052a90fda08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:39,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:39,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:39,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:39,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 57c13274da9b4baefeab4052a90fda08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68007006, jitterRate=0.013383358716964722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:39,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:39,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08., pid=12, masterSystemTime=1676714499893 2023-02-18 10:01:39,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:39,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=57c13274da9b4baefeab4052a90fda08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:39,909 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676714499909"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714499909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714499909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714499909"}]},"ts":"1676714499909"} 2023-02-18 10:01:39,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 10:01:39,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 57c13274da9b4baefeab4052a90fda08, server=jenkins-hbase4.apache.org,46059,1676714498497 in 168 msec 2023-02-18 10:01:39,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 10:01:39,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, ASSIGN in 324 msec 2023-02-18 10:01:39,913 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:39,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714499913"}]},"ts":"1676714499913"} 2023-02-18 10:01:39,914 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-18 10:01:39,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:39,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 356 msec 2023-02-18 10:01:40,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:40,167 INFO [Listener at localhost/36611] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-18 10:01:40,167 DEBUG [Listener at localhost/36611] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-18 10:01:40,167 INFO [Listener at localhost/36611] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:40,169 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-18 10:01:40,169 INFO [Listener at localhost/36611] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:40,169 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-18 10:01:40,169 INFO [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:40,201 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46059] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,282 INFO [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:40,282 INFO [Listener at localhost/36611] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:40,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 10:01:40,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714500283 (current time:1676714500283). 2023-02-18 10:01:40,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:40,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] zookeeper.ReadOnlyZKClient(139): Connect 0x3e405fdb to 127.0.0.1:60232 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:40,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@491a10be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:40,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:40,288 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46374, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e405fdb to 127.0.0.1:60232 2023-02-18 10:01:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:40,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 10:01:40,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 10:01:40,293 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 10:01:40,293 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676715100293 2023-02-18 10:01:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 10:01:40,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,297 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 10:01:40,297 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:40,297 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:40,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 10:01:40,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 6 msec 2023-02-18 10:01:40,298 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 10:01:40,299 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676715100299 2023-02-18 10:01:40,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,311 INFO [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-18 10:01:40,311 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:40,312 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-18 10:01:40,312 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 10:01:40,312 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,312 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,313 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:40,313 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:40,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:40,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:40,313 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,314 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,314 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-18 10:01:40,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-18 10:01:40,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,315 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-18 10:01:40,315 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:40,315 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-18 10:01:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 10:01:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 10:01:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 10:01:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44093,1676714498527' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 10:01:40,316 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 10:01:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46059,1676714498497' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 10:01:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,319 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:40,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46059,1676714498497' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-18 10:01:40,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79c46e9f[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:40,321 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 10:01:40,321 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 10:01:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 10:01:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44093,1676714498527' in zk 2023-02-18 10:01:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 10:01:40,322 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,322 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 10:01:40,322 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:40,322 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,323 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. started... 2023-02-18 10:01:40,323 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 57c13274da9b4baefeab4052a90fda08 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 10:01:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 10:01:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:40,323 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 10:01:40,337 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f1/88c7e4588bdb4a38a74ff2ae74bdb180 2023-02-18 10:01:40,353 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f2/8e7c7e4f0152410c8a9baa96d1f7c452 2023-02-18 10:01:40,358 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f1/88c7e4588bdb4a38a74ff2ae74bdb180 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/88c7e4588bdb4a38a74ff2ae74bdb180 2023-02-18 10:01:40,361 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/88c7e4588bdb4a38a74ff2ae74bdb180, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:40,362 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f2/8e7c7e4f0152410c8a9baa96d1f7c452 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8e7c7e4f0152410c8a9baa96d1f7c452 2023-02-18 10:01:40,365 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8e7c7e4f0152410c8a9baa96d1f7c452, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:40,366 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 57c13274da9b4baefeab4052a90fda08 in 43ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/88c7e4588bdb4a38a74ff2ae74bdb180] hfiles 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/88c7e4588bdb4a38a74ff2ae74bdb180 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8e7c7e4f0152410c8a9baa96d1f7c452] hfiles 2023-02-18 10:01:40,366 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8e7c7e4f0152410c8a9baa96d1f7c452 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,371 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. completed. 2023-02-18 10:01:40,371 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,371 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 10:01:40,371 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 10:01:40,371 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,371 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 10:01:40,372 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46059,1676714498497' in zk 2023-02-18 10:01:40,373 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,373 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 10:01:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:40,373 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:40,373 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 10:01:40,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,46059,1676714498497': 2023-02-18 10:01:40,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46059,1676714498497' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:40,376 INFO [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-18 10:01:40,376 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:40,376 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:40,376 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,376 INFO [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:40,378 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,378 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,378 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,378 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:40,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,378 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:40,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:40,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:40,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:40,379 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:40,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,380 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:40,381 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,381 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:40,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:40,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:40,387 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:40,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:40,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:40,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:40,388 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,387 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:40,388 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:40,388 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:40,388 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,388 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,388 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,397 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:40,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-18 10:01:40,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:40,399 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:40,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-18 10:01:40,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,416 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676714500295Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676714500387 (+92 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676714500387Writing data manifest for testWithMockedMapReduceSingleRegion at 1676714500390 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676714500396 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676714500415 (+19 ms) 2023-02-18 10:01:40,418 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 10:01:40,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 122 msec 2023-02-18 10:01:40,599 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:40,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-18 10:01:40,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:40,601 INFO [Listener at localhost/36611] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:40,604 INFO [Listener at localhost/36611] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:40,609 INFO [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:40,635 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46059] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,719 INFO [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:40,723 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:40,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,725 INFO [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-18 10:01:40,725 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:40,726 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-18 10:01:40,726 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 10:01:40,726 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,726 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,728 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:40,728 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:40,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:40,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:40,728 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,728 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,728 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:40,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-18 10:01:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-18 10:01:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 10:01:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 10:01:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44093,1676714498527' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 10:01:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 10:01:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 10:01:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:40,731 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,731 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. started... 2023-02-18 10:01:40,731 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 57c13274da9b4baefeab4052a90fda08 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 10:01:40,733 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:40,745 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f1/6c89809be06a4c8495b1ee2ca9e2cbe7 2023-02-18 10:01:40,763 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f2/8b9140f46aef49e4be039b6f5b7a0437 2023-02-18 10:01:40,766 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f1/6c89809be06a4c8495b1ee2ca9e2cbe7 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/6c89809be06a4c8495b1ee2ca9e2cbe7 2023-02-18 10:01:40,770 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/6c89809be06a4c8495b1ee2ca9e2cbe7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:40,771 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/.tmp/f2/8b9140f46aef49e4be039b6f5b7a0437 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8b9140f46aef49e4be039b6f5b7a0437 2023-02-18 10:01:40,774 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8b9140f46aef49e4be039b6f5b7a0437, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:40,775 INFO [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 57c13274da9b4baefeab4052a90fda08 in 44ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:40,776 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:40,776 DEBUG [rs(jenkins-hbase4.apache.org,46059,1676714498497)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,776 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 10:01:40,776 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 10:01:40,776 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,776 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 10:01:40,776 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46059,1676714498497' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 10:01:40,777 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,777 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:40,778 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,778 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:40,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46059,1676714498497' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-18 10:01:40,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dfbe57f[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:40,779 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 10:01:40,779 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,780 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,780 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,781 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 10:01:40,781 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 10:01:40,781 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,781 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:40,781 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 10:01:40,781 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 10:01:40,781 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46059,1676714498497' in zk 2023-02-18 10:01:40,781 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44093,1676714498527' in zk 2023-02-18 10:01:40,782 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,782 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 10:01:40,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:40,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:40,782 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:40,782 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 10:01:40,782 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:40,782 DEBUG [member: 'jenkins-hbase4.apache.org,46059,1676714498497' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 10:01:40,782 DEBUG [member: 'jenkins-hbase4.apache.org,44093,1676714498527' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 10:01:40,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,46059,1676714498497': 2023-02-18 10:01:40,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46059,1676714498497' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:40,785 INFO [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-18 10:01:40,785 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:40,785 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:40,785 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,785 INFO [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:40,788 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:40,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:40,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:40,788 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:40,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:40,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:40,789 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,790 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,790 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:40,793 DEBUG [(jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:40,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:40,793 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-18 10:01:40,793 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:40,793 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,794 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:40,794 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:40,794 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:40,894 DEBUG [Listener at localhost/36611] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:40,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:40,900 INFO [Listener at localhost/36611] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676714500283 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:40,900 DEBUG [Listener at localhost/36611] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41/data/default/testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,901 INFO [Listener at localhost/36611] snapshot.RestoreSnapshotHelper(239): region to add: 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:40,901 INFO [Listener at localhost/36611] snapshot.RestoreSnapshotHelper(585): clone region=57c13274da9b4baefeab4052a90fda08 as 57c13274da9b4baefeab4052a90fda08 in snapshot testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,902 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 57c13274da9b4baefeab4052a90fda08, NAME => 'testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41 2023-02-18 10:01:40,914 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:40,914 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 88c7e4588bdb4a38a74ff2ae74bdb180 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,916 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8e7c7e4f0152410c8a9baa96d1f7c452 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,918 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 57c13274da9b4baefeab4052a90fda08, disabling compactions & flushes 2023-02-18 10:01:40,918 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,918 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,918 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. after waiting 0 ms 2023-02-18 10:01:40,918 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,918 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,918 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:40,918 INFO [Listener at localhost/36611] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676714500283 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:40,918 DEBUG [Listener at localhost/36611] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41 2023-02-18 10:01:40,918 DEBUG [Listener at localhost/36611] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41 2023-02-18 10:01:40,919 DEBUG [Listener at localhost/36611] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:40,919 DEBUG [Listener at localhost/36611] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:40,919 DEBUG [Listener at localhost/36611] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-18 10:01:40,920 DEBUG [Listener at localhost/36611] util.CommonFSUtils(699): |----------57c13274da9b4baefeab4052a90fda08/ 2023-02-18 10:01:40,920 DEBUG [Listener at localhost/36611] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:40,920 DEBUG [Listener at localhost/36611] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:40,920 DEBUG [Listener at localhost/36611] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=57c13274da9b4baefeab4052a90fda08-88c7e4588bdb4a38a74ff2ae74bdb180 2023-02-18 10:01:40,920 DEBUG [Listener at localhost/36611] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:40,921 DEBUG [Listener at localhost/36611] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=57c13274da9b4baefeab4052a90fda08-8e7c7e4f0152410c8a9baa96d1f7c452 2023-02-18 10:01:40,923 INFO [Listener at localhost/36611] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 10:01:40,927 DEBUG [Listener at localhost/36611] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:40,927 INFO [Listener at localhost/36611] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:40,927 DEBUG [Listener at localhost/36611] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:40,929 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:40,930 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1 2023-02-18 10:01:40,930 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c13274da9b4baefeab4052a90fda08 columnFamilyName f1 2023-02-18 10:01:40,934 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(539): loaded hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/testWithMockedMapReduceSingleRegion=57c13274da9b4baefeab4052a90fda08-88c7e4588bdb4a38a74ff2ae74bdb180 2023-02-18 10:01:40,934 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(310): Store=57c13274da9b4baefeab4052a90fda08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:40,934 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:40,935 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2 2023-02-18 10:01:40,935 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c13274da9b4baefeab4052a90fda08 columnFamilyName f2 2023-02-18 10:01:40,938 DEBUG [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(539): loaded hdfs://localhost:45223/user/jenkins/test-data/6c66ddcb-0009-0105-896c-10c64e6cb350/testWithMockedMapReduceSingleRegion/53d89134-d6ef-419f-bec8-a89c0c236e41/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/testWithMockedMapReduceSingleRegion=57c13274da9b4baefeab4052a90fda08-8e7c7e4f0152410c8a9baa96d1f7c452 2023-02-18 10:01:40,939 INFO [StoreOpener-57c13274da9b4baefeab4052a90fda08-1] regionserver.HStore(310): Store=57c13274da9b4baefeab4052a90fda08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:40,939 DEBUG [Listener at localhost/36611] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:40,939 INFO [Listener at localhost/36611] regionserver.HRegion(1071): Opened 57c13274da9b4baefeab4052a90fda08; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61960076, jitterRate=-0.07672291994094849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:40,939 DEBUG [Listener at localhost/36611] regionserver.HRegion(964): Region open journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:40,983 DEBUG [Listener at localhost/36611] regionserver.HRegion(1603): Closing 57c13274da9b4baefeab4052a90fda08, disabling compactions & flushes 2023-02-18 10:01:40,983 INFO [Listener at localhost/36611] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,984 DEBUG [Listener at localhost/36611] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,984 DEBUG [Listener at localhost/36611] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. after waiting 0 ms 2023-02-18 10:01:40,984 DEBUG [Listener at localhost/36611] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,984 INFO [Listener at localhost/36611] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:40,985 DEBUG [Listener at localhost/36611] regionserver.HRegion(1557): Region close journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:40,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-18 10:01:40,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,991 INFO [Listener at localhost/36611] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:40,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:40,995 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714500995"}]},"ts":"1676714500995"} 2023-02-18 10:01:40,996 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-18 10:01:40,997 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-18 10:01:40,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, UNASSIGN}] 2023-02-18 10:01:40,999 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, UNASSIGN 2023-02-18 10:01:41,000 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=57c13274da9b4baefeab4052a90fda08, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:41,000 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676714501000"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714501000"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714501000"}]},"ts":"1676714501000"} 2023-02-18 10:01:41,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 57c13274da9b4baefeab4052a90fda08, server=jenkins-hbase4.apache.org,46059,1676714498497}] 2023-02-18 10:01:41,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:41,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:41,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 57c13274da9b4baefeab4052a90fda08, disabling compactions & flushes 2023-02-18 10:01:41,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:41,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:41,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. after waiting 0 ms 2023-02-18 10:01:41,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:41,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:41,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08. 2023-02-18 10:01:41,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 57c13274da9b4baefeab4052a90fda08: 2023-02-18 10:01:41,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:41,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=57c13274da9b4baefeab4052a90fda08, regionState=CLOSED 2023-02-18 10:01:41,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676714501159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714501159"}]},"ts":"1676714501159"} 2023-02-18 10:01:41,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 10:01:41,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 57c13274da9b4baefeab4052a90fda08, server=jenkins-hbase4.apache.org,46059,1676714498497 in 160 msec 2023-02-18 10:01:41,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 10:01:41,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=57c13274da9b4baefeab4052a90fda08, UNASSIGN in 164 msec 2023-02-18 10:01:41,164 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714501164"}]},"ts":"1676714501164"} 2023-02-18 10:01:41,165 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-18 10:01:41,167 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-18 10:01:41,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-18 10:01:41,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:41,297 INFO [Listener at localhost/36611] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-18 10:01:41,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,301 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,301 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:41,304 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:41,306 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1, FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2, FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/recovered.edits] 2023-02-18 10:01:41,309 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/6c89809be06a4c8495b1ee2ca9e2cbe7 to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/archive/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/6c89809be06a4c8495b1ee2ca9e2cbe7 2023-02-18 10:01:41,310 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/88c7e4588bdb4a38a74ff2ae74bdb180 to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/archive/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f1/88c7e4588bdb4a38a74ff2ae74bdb180 2023-02-18 10:01:41,312 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8b9140f46aef49e4be039b6f5b7a0437 to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/archive/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8b9140f46aef49e4be039b6f5b7a0437 2023-02-18 10:01:41,313 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8e7c7e4f0152410c8a9baa96d1f7c452 to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/archive/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/f2/8e7c7e4f0152410c8a9baa96d1f7c452 2023-02-18 10:01:41,315 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/recovered.edits/12.seqid to hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/archive/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08/recovered.edits/12.seqid 2023-02-18 10:01:41,315 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/.tmp/data/default/testWithMockedMapReduceSingleRegion/57c13274da9b4baefeab4052a90fda08 2023-02-18 10:01:41,315 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-18 10:01:41,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,318 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-18 10:01:41,319 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-18 10:01:41,320 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,320 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-18 10:01:41,320 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714501320"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:41,321 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 10:01:41,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 57c13274da9b4baefeab4052a90fda08, NAME => 'testWithMockedMapReduceSingleRegion,,1676714499560.57c13274da9b4baefeab4052a90fda08.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 10:01:41,321 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-18 10:01:41,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676714501321"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:41,322 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-18 10:01:41,325 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 10:01:41,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-18 10:01:41,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:41,403 INFO [Listener at localhost/36611] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-18 10:01:41,403 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:41,403 INFO [Listener at localhost/36611] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:41,403 DEBUG [Listener at localhost/36611] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d36c7f5 to 127.0.0.1:60232 2023-02-18 10:01:41,403 DEBUG [Listener at localhost/36611] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,404 DEBUG [Listener at localhost/36611] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:41,404 DEBUG [Listener at localhost/36611] util.JVMClusterUtil(257): Found active master hash=1879235646, stopped=false 2023-02-18 10:01:41,404 INFO [Listener at localhost/36611] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:41,405 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:41,405 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:41,405 INFO [Listener at localhost/36611] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:41,405 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:41,405 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:41,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:41,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:41,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:41,407 DEBUG [Listener at localhost/36611] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44c8ef49 to 127.0.0.1:60232 2023-02-18 10:01:41,407 DEBUG [Listener at localhost/36611] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,407 INFO [Listener at localhost/36611] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46059,1676714498497' ***** 2023-02-18 10:01:41,407 INFO [Listener at localhost/36611] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:41,407 INFO [Listener at localhost/36611] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44093,1676714498527' ***** 2023-02-18 10:01:41,407 INFO [Listener at localhost/36611] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:41,408 INFO [RS:0;jenkins-hbase4:46059] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:41,408 INFO [RS:1;jenkins-hbase4:44093] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:41,408 INFO [RS:0;jenkins-hbase4:46059] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:41,408 INFO [RS:1;jenkins-hbase4:44093] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:41,408 INFO [RS:0;jenkins-hbase4:46059] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:41,408 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:41,408 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:41,408 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:41,409 DEBUG [RS:0;jenkins-hbase4:46059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7643d350 to 127.0.0.1:60232 2023-02-18 10:01:41,408 INFO [RS:1;jenkins-hbase4:44093] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:41,410 DEBUG [RS:0;jenkins-hbase4:46059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,410 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(3304): Received CLOSE for fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:41,410 INFO [RS:0;jenkins-hbase4:46059] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:41,410 INFO [RS:0;jenkins-hbase4:46059] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:41,410 INFO [RS:0;jenkins-hbase4:46059] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:41,410 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:41,410 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:41,410 DEBUG [RS:1;jenkins-hbase4:44093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f0c0a2 to 127.0.0.1:60232 2023-02-18 10:01:41,410 DEBUG [RS:1;jenkins-hbase4:44093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,410 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fccb79980a4b65a7669486cb4acb161a, disabling compactions & flushes 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:41,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:41,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:41,410 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 10:01:41,410 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. after waiting 0 ms 2023-02-18 10:01:41,410 DEBUG [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:41,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing fccb79980a4b65a7669486cb4acb161a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:41,410 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1479): Online Regions={fccb79980a4b65a7669486cb4acb161a=hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a.} 2023-02-18 10:01:41,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:41,411 DEBUG [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1505): Waiting on fccb79980a4b65a7669486cb4acb161a 2023-02-18 10:01:41,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-18 10:01:41,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/.tmp/info/5a97f2b7d9504b1b9e6ffd63dd429619 2023-02-18 10:01:41,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/.tmp/info/1907a214ff2b41d3a9604b80b7aaa214 2023-02-18 10:01:41,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1907a214ff2b41d3a9604b80b7aaa214 2023-02-18 10:01:41,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/.tmp/info/5a97f2b7d9504b1b9e6ffd63dd429619 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/info/5a97f2b7d9504b1b9e6ffd63dd429619 2023-02-18 10:01:41,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/info/5a97f2b7d9504b1b9e6ffd63dd429619, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:41,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fccb79980a4b65a7669486cb4acb161a in 16ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:41,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/.tmp/rep_barrier/1003e49c5a654d33a96df2de06c54bfb 2023-02-18 10:01:41,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/namespace/fccb79980a4b65a7669486cb4acb161a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:41,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:41,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fccb79980a4b65a7669486cb4acb161a: 2023-02-18 10:01:41,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714499082.fccb79980a4b65a7669486cb4acb161a. 2023-02-18 10:01:41,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1003e49c5a654d33a96df2de06c54bfb 2023-02-18 10:01:41,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/.tmp/table/11b3ed1393954f3d93a05acc03f303b1 2023-02-18 10:01:41,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11b3ed1393954f3d93a05acc03f303b1 2023-02-18 10:01:41,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/.tmp/info/1907a214ff2b41d3a9604b80b7aaa214 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/info/1907a214ff2b41d3a9604b80b7aaa214 2023-02-18 10:01:41,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1907a214ff2b41d3a9604b80b7aaa214 2023-02-18 10:01:41,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/info/1907a214ff2b41d3a9604b80b7aaa214, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 10:01:41,444 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/.tmp/rep_barrier/1003e49c5a654d33a96df2de06c54bfb as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/rep_barrier/1003e49c5a654d33a96df2de06c54bfb 2023-02-18 10:01:41,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1003e49c5a654d33a96df2de06c54bfb 2023-02-18 10:01:41,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/rep_barrier/1003e49c5a654d33a96df2de06c54bfb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 10:01:41,447 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/.tmp/table/11b3ed1393954f3d93a05acc03f303b1 as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/table/11b3ed1393954f3d93a05acc03f303b1 2023-02-18 10:01:41,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11b3ed1393954f3d93a05acc03f303b1 2023-02-18 10:01:41,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/table/11b3ed1393954f3d93a05acc03f303b1, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 10:01:41,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 43ms, sequenceid=21, compaction requested=false 2023-02-18 10:01:41,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 10:01:41,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:41,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:41,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:41,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:41,489 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:41,492 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:41,610 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46059,1676714498497; all regions closed. 2023-02-18 10:01:41,611 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44093,1676714498527; all regions closed. 2023-02-18 10:01:41,615 DEBUG [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/oldWALs 2023-02-18 10:01:41,615 DEBUG [RS:1;jenkins-hbase4:44093] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/oldWALs 2023-02-18 10:01:41,615 INFO [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46059%2C1676714498497.meta:.meta(num 1676714499003) 2023-02-18 10:01:41,615 INFO [RS:1;jenkins-hbase4:44093] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44093%2C1676714498527:(num 1676714499443) 2023-02-18 10:01:41,615 DEBUG [RS:1;jenkins-hbase4:44093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,615 INFO [RS:1;jenkins-hbase4:44093] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:41,615 INFO [RS:1;jenkins-hbase4:44093] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:41,615 INFO [RS:1;jenkins-hbase4:44093] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:41,615 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:41,615 INFO [RS:1;jenkins-hbase4:44093] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:41,615 INFO [RS:1;jenkins-hbase4:44093] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:41,616 INFO [RS:1;jenkins-hbase4:44093] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44093 2023-02-18 10:01:41,618 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:41,618 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44093,1676714498527 2023-02-18 10:01:41,618 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fbc1f4c rejected from java.util.concurrent.ThreadPoolExecutor@5b839063[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:41,618 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:41,618 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@102cd6d7 rejected from java.util.concurrent.ThreadPoolExecutor@5b839063[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:41,618 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:41,618 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:41,620 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44093,1676714498527] 2023-02-18 10:01:41,620 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44093,1676714498527; numProcessing=1 2023-02-18 10:01:41,621 DEBUG [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/oldWALs 2023-02-18 10:01:41,621 INFO [RS:0;jenkins-hbase4:46059] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46059%2C1676714498497:(num 1676714499811) 2023-02-18 10:01:41,621 DEBUG [RS:0;jenkins-hbase4:46059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,621 INFO [RS:0;jenkins-hbase4:46059] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:41,621 INFO [RS:0;jenkins-hbase4:46059] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:41,621 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:41,622 INFO [RS:0;jenkins-hbase4:46059] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46059 2023-02-18 10:01:41,623 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44093,1676714498527 already deleted, retry=false 2023-02-18 10:01:41,623 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44093,1676714498527 expired; onlineServers=1 2023-02-18 10:01:41,624 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46059,1676714498497 2023-02-18 10:01:41,624 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:41,624 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5678d899 rejected from java.util.concurrent.ThreadPoolExecutor@5247468e[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:41,625 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46059,1676714498497] 2023-02-18 10:01:41,625 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46059,1676714498497; numProcessing=2 2023-02-18 10:01:41,626 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46059,1676714498497 already deleted, retry=false 2023-02-18 10:01:41,626 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46059,1676714498497 expired; onlineServers=0 2023-02-18 10:01:41,626 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39073,1676714498453' ***** 2023-02-18 10:01:41,626 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:41,627 DEBUG [M:0;jenkins-hbase4:39073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@743d56e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:41,627 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39073,1676714498453 2023-02-18 10:01:41,627 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39073,1676714498453; all regions closed. 2023-02-18 10:01:41,627 DEBUG [M:0;jenkins-hbase4:39073] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:41,627 DEBUG [M:0;jenkins-hbase4:39073] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:41,627 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:41,627 DEBUG [M:0;jenkins-hbase4:39073] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:41,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714498654] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714498654,5,FailOnTimeoutGroup] 2023-02-18 10:01:41,627 INFO [M:0;jenkins-hbase4:39073] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:41,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714498654] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714498654,5,FailOnTimeoutGroup] 2023-02-18 10:01:41,628 INFO [M:0;jenkins-hbase4:39073] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:41,628 INFO [M:0;jenkins-hbase4:39073] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:41,628 DEBUG [M:0;jenkins-hbase4:39073] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:41,628 INFO [M:0;jenkins-hbase4:39073] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:41,629 ERROR [M:0;jenkins-hbase4:39073] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 10:01:41,629 INFO [M:0;jenkins-hbase4:39073] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:41,629 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:41,629 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:41,629 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:41,629 DEBUG [M:0;jenkins-hbase4:39073] zookeeper.ZKUtil(398): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:41,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:41,629 WARN [M:0;jenkins-hbase4:39073] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:41,630 INFO [M:0;jenkins-hbase4:39073] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:41,630 INFO [M:0;jenkins-hbase4:39073] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:41,630 DEBUG [M:0;jenkins-hbase4:39073] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:41,630 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:41,630 DEBUG [M:0;jenkins-hbase4:39073] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:41,630 DEBUG [M:0;jenkins-hbase4:39073] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:41,630 DEBUG [M:0;jenkins-hbase4:39073] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:41,630 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.07 KB 2023-02-18 10:01:41,639 INFO [M:0;jenkins-hbase4:39073] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/62b64508f20148649ec976b07bdc195e 2023-02-18 10:01:41,642 DEBUG [M:0;jenkins-hbase4:39073] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/62b64508f20148649ec976b07bdc195e as hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/62b64508f20148649ec976b07bdc195e 2023-02-18 10:01:41,646 INFO [M:0;jenkins-hbase4:39073] regionserver.HStore(1080): Added hdfs://localhost:45223/user/jenkins/test-data/7eb49f36-2034-60cd-e758-eb42e41bac5d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/62b64508f20148649ec976b07bdc195e, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 10:01:41,647 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57482, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-18 10:01:41,647 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:41,648 DEBUG [M:0;jenkins-hbase4:39073] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:41,650 INFO [M:0;jenkins-hbase4:39073] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:41,650 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:41,651 INFO [M:0;jenkins-hbase4:39073] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39073 2023-02-18 10:01:41,653 DEBUG [M:0;jenkins-hbase4:39073] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39073,1676714498453 already deleted, retry=false 2023-02-18 10:01:41,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 10:01:41,906 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:41,906 INFO [M:0;jenkins-hbase4:39073] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39073,1676714498453; zookeeper connection closed. 2023-02-18 10:01:41,906 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4852a7ea rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:41,906 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): master:39073-0x10066e0c3490000, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:41,906 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@659c32b5 rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:42,006 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:42,006 INFO [RS:0;jenkins-hbase4:46059] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46059,1676714498497; zookeeper connection closed. 2023-02-18 10:01:42,006 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3634cd69 rejected from java.util.concurrent.ThreadPoolExecutor@5247468e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:42,006 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:46059-0x10066e0c3490001, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:42,006 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e03264d rejected from java.util.concurrent.ThreadPoolExecutor@5247468e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:42,007 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3874d030] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3874d030 2023-02-18 10:01:42,106 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:42,106 INFO [RS:1;jenkins-hbase4:44093] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44093,1676714498527; zookeeper connection closed. 2023-02-18 10:01:42,106 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@689270f0 rejected from java.util.concurrent.ThreadPoolExecutor@5b839063[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:42,106 DEBUG [Listener at localhost/36611-EventThread] zookeeper.ZKWatcher(600): regionserver:44093-0x10066e0c3490002, quorum=127.0.0.1:60232, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:42,106 ERROR [Listener at localhost/36611-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8420154 rejected from java.util.concurrent.ThreadPoolExecutor@5b839063[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:42,106 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e0cd45b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e0cd45b 2023-02-18 10:01:42,107 INFO [Listener at localhost/36611] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:42,108 WARN [Listener at localhost/36611] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:42,110 INFO [Listener at localhost/36611] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:42,218 WARN [BP-1048873405-172.31.14.131-1676714497744 heartbeating to localhost/127.0.0.1:45223] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:42,218 WARN [BP-1048873405-172.31.14.131-1676714497744 heartbeating to localhost/127.0.0.1:45223] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1048873405-172.31.14.131-1676714497744 (Datanode Uuid ea12563c-bb5f-49f5-9d12-a4ab9fa41f35) service to localhost/127.0.0.1:45223 2023-02-18 10:01:42,218 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/dfs/data/data3/current/BP-1048873405-172.31.14.131-1676714497744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:42,219 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/dfs/data/data4/current/BP-1048873405-172.31.14.131-1676714497744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:42,220 WARN [Listener at localhost/36611] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:42,224 INFO [Listener at localhost/36611] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:42,328 WARN [BP-1048873405-172.31.14.131-1676714497744 heartbeating to localhost/127.0.0.1:45223] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:42,329 WARN [BP-1048873405-172.31.14.131-1676714497744 heartbeating to localhost/127.0.0.1:45223] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1048873405-172.31.14.131-1676714497744 (Datanode Uuid 51643de5-151a-432e-a42b-bd3aed66fa09) service to localhost/127.0.0.1:45223 2023-02-18 10:01:42,329 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/dfs/data/data1/current/BP-1048873405-172.31.14.131-1676714497744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:42,330 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/cluster_3bf88961-ba91-199b-4225-eba705501b40/dfs/data/data2/current/BP-1048873405-172.31.14.131-1676714497744] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:42,339 INFO [Listener at localhost/36611] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:42,464 INFO [Listener at localhost/36611] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:42,478 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:42,490 INFO [Listener at localhost/36611] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=251 (was 227) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45223 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36611 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39073,1676714498453)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:45223 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45223 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:45223 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36611.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45223 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45223 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:45223 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=649 (was 631) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 222), ProcessCount=170 (was 170), AvailableMemoryMB=8624 (was 8662) 2023-02-18 10:01:42,501 INFO [Listener at localhost/36611] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=251, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=8623 2023-02-18 10:01:42,511 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/hadoop.log.dir so I do NOT create it in target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab 2023-02-18 10:01:42,511 WARN [Listener at localhost/36611] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 10:01:42,511 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/hadoop.tmp.dir so I do NOT create it in target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab 2023-02-18 10:01:42,511 WARN [Listener at localhost/36611] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f23607ce-61a0-4412-070c-a8aef174613b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 10:01:42,511 DEBUG [Listener at localhost/36611] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a, deleteOnExit=true 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/test.cache.data in system properties and HBase conf 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:01:42,512 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:01:42,512 DEBUG [Listener at localhost/36611] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:01:42,513 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:01:42,514 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:42,514 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:01:42,514 INFO [Listener at localhost/36611] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:01:42,518 WARN [Listener at localhost/36611] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:42,519 WARN [Listener at localhost/36611] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:42,565 WARN [Listener at localhost/36611] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:42,567 INFO [Listener at localhost/36611] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:42,571 INFO [Listener at localhost/36611] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/java.io.tmpdir/Jetty_localhost_34209_hdfs____dls290/webapp 2023-02-18 10:01:42,664 INFO [Listener at localhost/36611] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34209 2023-02-18 10:01:42,668 WARN [Listener at localhost/36611] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:42,668 WARN [Listener at localhost/36611] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:42,710 WARN [Listener at localhost/43855] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:42,723 WARN [Listener at localhost/43855] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:42,725 WARN [Listener at localhost/43855] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:42,726 INFO [Listener at localhost/43855] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:42,731 INFO [Listener at localhost/43855] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/java.io.tmpdir/Jetty_localhost_46231_datanode____.hlaaq3/webapp 2023-02-18 10:01:42,843 INFO [Listener at localhost/43855] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46231 2023-02-18 10:01:42,851 WARN [Listener at localhost/37105] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:42,867 WARN [Listener at localhost/37105] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:42,869 WARN [Listener at localhost/37105] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:42,870 INFO [Listener at localhost/37105] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:42,874 INFO [Listener at localhost/37105] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/java.io.tmpdir/Jetty_localhost_41249_datanode____.mjyqgv/webapp 2023-02-18 10:01:42,940 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7be17b0e4e685e1f: Processing first storage report for DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d from datanode 9533fe54-337f-45b5-b311-024cd87ef610 2023-02-18 10:01:42,941 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7be17b0e4e685e1f: from storage DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d node DatanodeRegistration(127.0.0.1:46317, datanodeUuid=9533fe54-337f-45b5-b311-024cd87ef610, infoPort=42007, infoSecurePort=0, ipcPort=37105, storageInfo=lv=-57;cid=testClusterID;nsid=260216700;c=1676714502521), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 10:01:42,941 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7be17b0e4e685e1f: Processing first storage report for DS-4a31c657-8b26-43cf-9997-f1a8fb6955b7 from datanode 9533fe54-337f-45b5-b311-024cd87ef610 2023-02-18 10:01:42,941 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7be17b0e4e685e1f: from storage DS-4a31c657-8b26-43cf-9997-f1a8fb6955b7 node DatanodeRegistration(127.0.0.1:46317, datanodeUuid=9533fe54-337f-45b5-b311-024cd87ef610, infoPort=42007, infoSecurePort=0, ipcPort=37105, storageInfo=lv=-57;cid=testClusterID;nsid=260216700;c=1676714502521), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:42,973 INFO [Listener at localhost/37105] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41249 2023-02-18 10:01:42,980 WARN [Listener at localhost/37715] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:43,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xce18b684bad2c794: Processing first storage report for DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63 from datanode 87c91607-482d-4b43-bd30-438df4ff4610 2023-02-18 10:01:43,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce18b684bad2c794: from storage DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63 node DatanodeRegistration(127.0.0.1:44461, datanodeUuid=87c91607-482d-4b43-bd30-438df4ff4610, infoPort=34785, infoSecurePort=0, ipcPort=37715, storageInfo=lv=-57;cid=testClusterID;nsid=260216700;c=1676714502521), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:43,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xce18b684bad2c794: Processing first storage report for DS-a94137cb-9919-4220-ab5c-861c0a60a55c from datanode 87c91607-482d-4b43-bd30-438df4ff4610 2023-02-18 10:01:43,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xce18b684bad2c794: from storage DS-a94137cb-9919-4220-ab5c-861c0a60a55c node DatanodeRegistration(127.0.0.1:44461, datanodeUuid=87c91607-482d-4b43-bd30-438df4ff4610, infoPort=34785, infoSecurePort=0, ipcPort=37715, storageInfo=lv=-57;cid=testClusterID;nsid=260216700;c=1676714502521), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:43,086 DEBUG [Listener at localhost/37715] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab 2023-02-18 10:01:43,089 INFO [Listener at localhost/37715] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/zookeeper_0, clientPort=59115, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:01:43,089 INFO [Listener at localhost/37715] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59115 2023-02-18 10:01:43,090 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,091 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,104 INFO [Listener at localhost/37715] util.FSUtils(479): Created version file at hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5 with version=8 2023-02-18 10:01:43,104 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,105 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,106 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43855/user/jenkins/test-data/142615b4-23d7-2b88-938a-ec0b831523fd/hbase-staging 2023-02-18 10:01:43,107 INFO [Listener at localhost/37715] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:43,108 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,108 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,108 INFO [Listener at localhost/37715] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:43,108 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,108 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:43,108 INFO [Listener at localhost/37715] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:43,109 INFO [Listener at localhost/37715] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41123 2023-02-18 10:01:43,109 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,110 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,110 INFO [Listener at localhost/37715] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41123 connecting to ZooKeeper ensemble=127.0.0.1:59115 2023-02-18 10:01:43,117 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:411230x0, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:43,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41123-0x10066e0d5750000 connected 2023-02-18 10:01:43,136 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:43,136 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:43,136 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:43,137 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41123 2023-02-18 10:01:43,137 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41123 2023-02-18 10:01:43,137 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41123 2023-02-18 10:01:43,137 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41123 2023-02-18 10:01:43,137 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41123 2023-02-18 10:01:43,138 INFO [Listener at localhost/37715] master.HMaster(444): hbase.rootdir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5, hbase.cluster.distributed=false 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:43,149 INFO [Listener at localhost/37715] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:43,150 INFO [Listener at localhost/37715] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38851 2023-02-18 10:01:43,150 INFO [Listener at localhost/37715] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:43,151 DEBUG [Listener at localhost/37715] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:43,151 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,152 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,153 INFO [Listener at localhost/37715] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38851 connecting to ZooKeeper ensemble=127.0.0.1:59115 2023-02-18 10:01:43,155 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:388510x0, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:43,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38851-0x10066e0d5750001 connected 2023-02-18 10:01:43,156 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:43,156 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:43,156 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:43,157 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38851 2023-02-18 10:01:43,157 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38851 2023-02-18 10:01:43,157 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38851 2023-02-18 10:01:43,158 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38851 2023-02-18 10:01:43,158 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38851 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:43,168 INFO [Listener at localhost/37715] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:43,169 INFO [Listener at localhost/37715] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45081 2023-02-18 10:01:43,169 INFO [Listener at localhost/37715] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:43,169 DEBUG [Listener at localhost/37715] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:43,170 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,171 INFO [Listener at localhost/37715] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,172 INFO [Listener at localhost/37715] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45081 connecting to ZooKeeper ensemble=127.0.0.1:59115 2023-02-18 10:01:43,175 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:450810x0, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:43,176 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): regionserver:450810x0, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:43,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45081-0x10066e0d5750002 connected 2023-02-18 10:01:43,177 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:43,177 DEBUG [Listener at localhost/37715] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:43,177 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45081 2023-02-18 10:01:43,178 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45081 2023-02-18 10:01:43,178 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45081 2023-02-18 10:01:43,178 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45081 2023-02-18 10:01:43,178 DEBUG [Listener at localhost/37715] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45081 2023-02-18 10:01:43,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,182 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:43,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,183 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:43,183 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:43,183 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,183 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:43,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:43,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:43,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41123,1676714503107 from backup master directory 2023-02-18 10:01:43,187 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,187 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:43,187 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:43,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/hbase.id with ID: be6bb8f9-b84a-4803-91dd-7a8779b1791f 2023-02-18 10:01:43,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:43,209 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1cda01ec to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:43,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66eb1e8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:43,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:43,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:43,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:43,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store-tmp 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:43,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:43,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:43,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/WALs/jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41123%2C1676714503107, suffix=, logDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/WALs/jenkins-hbase4.apache.org,41123,1676714503107, archiveDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:43,239 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK] 2023-02-18 10:01:43,239 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK] 2023-02-18 10:01:43,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/WALs/jenkins-hbase4.apache.org,41123,1676714503107/jenkins-hbase4.apache.org%2C41123%2C1676714503107.1676714503227 2023-02-18 10:01:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK], DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK]] 2023-02-18 10:01:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:43,242 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:43,243 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:43,243 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:43,243 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:43,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:43,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:43,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:43,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73543239, jitterRate=0.09587965905666351}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:43,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:43,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:43,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:43,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 10:01:43,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 10:01:43,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:43,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:43,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:43,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:43,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:43,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:43,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:43,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:43,262 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:43,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:43,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:43,264 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:43,264 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:43,264 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,264 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:43,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41123,1676714503107, sessionid=0x10066e0d5750000, setting cluster-up flag (Was=false) 2023-02-18 10:01:43,270 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:43,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,276 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:43,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:43,282 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.hbase-snapshot/.tmp 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:43,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714533290 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:43,290 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:43,290 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:43,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:43,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:43,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:43,292 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:43,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:43,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:43,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714503292,5,FailOnTimeoutGroup] 2023-02-18 10:01:43,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714503292,5,FailOnTimeoutGroup] 2023-02-18 10:01:43,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:43,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,321 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:43,323 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:43,323 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5 2023-02-18 10:01:43,342 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:43,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:43,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/info 2023-02-18 10:01:43,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:43,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:43,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:43,348 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:43,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:43,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/table 2023-02-18 10:01:43,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:43,350 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,351 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740 2023-02-18 10:01:43,352 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740 2023-02-18 10:01:43,356 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:43,359 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:43,364 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:43,364 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64608708, jitterRate=-0.03725522756576538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:43,365 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:43,365 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:43,365 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:43,365 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:43,365 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:43,365 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:43,365 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:43,365 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:43,367 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:43,367 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:43,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:43,370 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:43,371 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:43,381 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(952): ClusterId : be6bb8f9-b84a-4803-91dd-7a8779b1791f 2023-02-18 10:01:43,381 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(952): ClusterId : be6bb8f9-b84a-4803-91dd-7a8779b1791f 2023-02-18 10:01:43,381 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:43,381 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:43,383 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:43,383 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:43,383 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:43,384 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:43,387 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:43,388 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:43,388 DEBUG [RS:0;jenkins-hbase4:38851] zookeeper.ReadOnlyZKClient(139): Connect 0x6bb48ac6 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:43,389 DEBUG [RS:1;jenkins-hbase4:45081] zookeeper.ReadOnlyZKClient(139): Connect 0x43cf695a to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:43,394 DEBUG [RS:1;jenkins-hbase4:45081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d088f53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:43,394 DEBUG [RS:0;jenkins-hbase4:38851] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@657379c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:43,394 DEBUG [RS:1;jenkins-hbase4:45081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4937022a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:43,394 DEBUG [RS:0;jenkins-hbase4:38851] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@614ce1b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:43,402 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45081 2023-02-18 10:01:43,402 INFO [RS:1;jenkins-hbase4:45081] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:43,402 INFO [RS:1;jenkins-hbase4:45081] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:43,402 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:43,403 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41123,1676714503107 with isa=jenkins-hbase4.apache.org/172.31.14.131:45081, startcode=1676714503167 2023-02-18 10:01:43,403 DEBUG [RS:1;jenkins-hbase4:45081] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:43,404 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59495, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:43,405 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38851 2023-02-18 10:01:43,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,407 INFO [RS:0;jenkins-hbase4:38851] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:43,407 INFO [RS:0;jenkins-hbase4:38851] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:43,407 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:43,407 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5 2023-02-18 10:01:43,407 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43855 2023-02-18 10:01:43,407 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:43,407 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41123,1676714503107 with isa=jenkins-hbase4.apache.org/172.31.14.131:38851, startcode=1676714503149 2023-02-18 10:01:43,407 DEBUG [RS:0;jenkins-hbase4:38851] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:43,409 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:43,410 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48671, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:43,410 DEBUG [RS:1;jenkins-hbase4:45081] zookeeper.ZKUtil(162): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,410 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45081,1676714503167] 2023-02-18 10:01:43,410 WARN [RS:1;jenkins-hbase4:45081] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:43,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,410 INFO [RS:1;jenkins-hbase4:45081] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:43,410 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,410 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5 2023-02-18 10:01:43,410 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43855 2023-02-18 10:01:43,410 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:43,421 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:43,421 DEBUG [RS:0;jenkins-hbase4:38851] zookeeper.ZKUtil(162): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,421 WARN [RS:0;jenkins-hbase4:38851] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:43,421 INFO [RS:0;jenkins-hbase4:38851] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:43,421 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38851,1676714503149] 2023-02-18 10:01:43,421 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,421 DEBUG [RS:1;jenkins-hbase4:45081] zookeeper.ZKUtil(162): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,422 DEBUG [RS:1;jenkins-hbase4:45081] zookeeper.ZKUtil(162): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,424 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:43,424 INFO [RS:1;jenkins-hbase4:45081] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:43,425 DEBUG [RS:0;jenkins-hbase4:38851] zookeeper.ZKUtil(162): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,425 INFO [RS:1;jenkins-hbase4:45081] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:43,426 INFO [RS:1;jenkins-hbase4:45081] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:43,426 DEBUG [RS:0;jenkins-hbase4:38851] zookeeper.ZKUtil(162): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,426 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,427 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:43,427 INFO [RS:0;jenkins-hbase4:38851] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:43,428 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:43,429 INFO [RS:0;jenkins-hbase4:38851] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:43,429 INFO [RS:0;jenkins-hbase4:38851] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:43,429 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,429 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:43,429 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:1;jenkins-hbase4:45081] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,431 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,432 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,432 DEBUG [RS:0;jenkins-hbase4:38851] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:43,438 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,439 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,440 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,440 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,440 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,440 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,455 INFO [RS:0;jenkins-hbase4:38851] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:43,455 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38851,1676714503149-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,457 INFO [RS:1;jenkins-hbase4:45081] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:43,457 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45081,1676714503167-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,467 INFO [RS:0;jenkins-hbase4:38851] regionserver.Replication(203): jenkins-hbase4.apache.org,38851,1676714503149 started 2023-02-18 10:01:43,467 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38851,1676714503149, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38851, sessionid=0x10066e0d5750001 2023-02-18 10:01:43,467 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:43,467 DEBUG [RS:0;jenkins-hbase4:38851] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,467 DEBUG [RS:0;jenkins-hbase4:38851] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38851,1676714503149' 2023-02-18 10:01:43,467 DEBUG [RS:0;jenkins-hbase4:38851] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:43,468 DEBUG [RS:0;jenkins-hbase4:38851] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:43,468 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:43,468 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:43,468 DEBUG [RS:0;jenkins-hbase4:38851] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,468 DEBUG [RS:0;jenkins-hbase4:38851] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38851,1676714503149' 2023-02-18 10:01:43,468 DEBUG [RS:0;jenkins-hbase4:38851] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:43,469 DEBUG [RS:0;jenkins-hbase4:38851] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:43,469 DEBUG [RS:0;jenkins-hbase4:38851] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:43,469 INFO [RS:0;jenkins-hbase4:38851] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:43,469 INFO [RS:0;jenkins-hbase4:38851] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:43,472 INFO [RS:1;jenkins-hbase4:45081] regionserver.Replication(203): jenkins-hbase4.apache.org,45081,1676714503167 started 2023-02-18 10:01:43,472 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45081,1676714503167, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45081, sessionid=0x10066e0d5750002 2023-02-18 10:01:43,472 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:43,472 DEBUG [RS:1;jenkins-hbase4:45081] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,472 DEBUG [RS:1;jenkins-hbase4:45081] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45081,1676714503167' 2023-02-18 10:01:43,472 DEBUG [RS:1;jenkins-hbase4:45081] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:43,472 DEBUG [RS:1;jenkins-hbase4:45081] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45081,1676714503167' 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:43,473 DEBUG [RS:1;jenkins-hbase4:45081] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:43,473 INFO [RS:1;jenkins-hbase4:45081] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:43,473 INFO [RS:1;jenkins-hbase4:45081] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:43,521 DEBUG [jenkins-hbase4:41123] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:43,522 DEBUG [jenkins-hbase4:41123] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:43,523 DEBUG [jenkins-hbase4:41123] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:43,523 DEBUG [jenkins-hbase4:41123] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:43,523 DEBUG [jenkins-hbase4:41123] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:43,523 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45081,1676714503167, state=OPENING 2023-02-18 10:01:43,525 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:43,526 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:43,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45081,1676714503167}] 2023-02-18 10:01:43,530 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:43,680 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:43,680 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:43,681 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:43,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:43,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:43,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45081%2C1676714503167.meta, suffix=.meta, logDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,45081,1676714503167, archiveDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/oldWALs, maxLogs=32 2023-02-18 10:01:43,698 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK] 2023-02-18 10:01:43,698 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK] 2023-02-18 10:01:43,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,45081,1676714503167/jenkins-hbase4.apache.org%2C45081%2C1676714503167.meta.1676714503686.meta 2023-02-18 10:01:43,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK], DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK]] 2023-02-18 10:01:43,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:43,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:43,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:43,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:43,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:43,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:43,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:43,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:43,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:43,702 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/info 2023-02-18 10:01:43,702 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/info 2023-02-18 10:01:43,703 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:43,703 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,703 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:43,704 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:43,704 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:43,704 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:43,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:43,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/table 2023-02-18 10:01:43,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/table 2023-02-18 10:01:43,705 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:43,706 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:43,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740 2023-02-18 10:01:43,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740 2023-02-18 10:01:43,708 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:43,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:43,710 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63398804, jitterRate=-0.055284202098846436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:43,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:43,710 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714503680 2023-02-18 10:01:43,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:43,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:43,717 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45081,1676714503167, state=OPEN 2023-02-18 10:01:43,718 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:43,718 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:43,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:43,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45081,1676714503167 in 192 msec 2023-02-18 10:01:43,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:43,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-18 10:01:43,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 438 msec 2023-02-18 10:01:43,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714503722, completionTime=-1 2023-02-18 10:01:43,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:43,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:43,723 DEBUG [hconnection-0x42b9a9fd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:43,725 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56522, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:43,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:43,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714563726 2023-02-18 10:01:43,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714623726 2023-02-18 10:01:43,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-18 10:01:43,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41123,1676714503107-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41123,1676714503107-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41123,1676714503107-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41123, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:43,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:43,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:43,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:43,739 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:43,739 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:43,740 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:43,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:43,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea empty. 2023-02-18 10:01:43,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:43,741 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:43,749 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:43,749 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9c58b69a75c1f8e2aa25775532d5cea, NAME => 'hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp 2023-02-18 10:01:43,754 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:43,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c9c58b69a75c1f8e2aa25775532d5cea, disabling compactions & flushes 2023-02-18 10:01:43,755 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:43,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:43,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. after waiting 0 ms 2023-02-18 10:01:43,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:43,755 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:43,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c9c58b69a75c1f8e2aa25775532d5cea: 2023-02-18 10:01:43,756 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:43,757 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714503757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714503757"}]},"ts":"1676714503757"} 2023-02-18 10:01:43,758 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:43,758 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:43,759 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714503758"}]},"ts":"1676714503758"} 2023-02-18 10:01:43,759 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:43,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:43,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:43,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:43,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:43,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c9c58b69a75c1f8e2aa25775532d5cea, ASSIGN}] 2023-02-18 10:01:43,765 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c9c58b69a75c1f8e2aa25775532d5cea, ASSIGN 2023-02-18 10:01:43,765 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c9c58b69a75c1f8e2aa25775532d5cea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38851,1676714503149; forceNewPlan=false, retain=false 2023-02-18 10:01:43,915 INFO [jenkins-hbase4:41123] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:43,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c9c58b69a75c1f8e2aa25775532d5cea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:43,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714503916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714503916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714503916"}]},"ts":"1676714503916"} 2023-02-18 10:01:43,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c9c58b69a75c1f8e2aa25775532d5cea, server=jenkins-hbase4.apache.org,38851,1676714503149}] 2023-02-18 10:01:44,071 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:44,071 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:44,073 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:44,077 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:44,078 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38851%2C1676714503149, suffix=, logDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,38851,1676714503149, archiveDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/oldWALs, maxLogs=32 2023-02-18 10:01:44,090 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK] 2023-02-18 10:01:44,091 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK] 2023-02-18 10:01:44,092 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,38851,1676714503149/jenkins-hbase4.apache.org%2C38851%2C1676714503149.1676714504078 2023-02-18 10:01:44,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK], DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK]] 2023-02-18 10:01:44,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9c58b69a75c1f8e2aa25775532d5cea, NAME => 'hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:44,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:44,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,094 INFO [StoreOpener-c9c58b69a75c1f8e2aa25775532d5cea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,096 DEBUG [StoreOpener-c9c58b69a75c1f8e2aa25775532d5cea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/info 2023-02-18 10:01:44,096 DEBUG [StoreOpener-c9c58b69a75c1f8e2aa25775532d5cea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/info 2023-02-18 10:01:44,096 INFO [StoreOpener-c9c58b69a75c1f8e2aa25775532d5cea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c58b69a75c1f8e2aa25775532d5cea columnFamilyName info 2023-02-18 10:01:44,096 INFO [StoreOpener-c9c58b69a75c1f8e2aa25775532d5cea-1] regionserver.HStore(310): Store=c9c58b69a75c1f8e2aa25775532d5cea/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:44,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:44,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:44,103 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c9c58b69a75c1f8e2aa25775532d5cea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62624829, jitterRate=-0.06681732833385468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:44,103 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c9c58b69a75c1f8e2aa25775532d5cea: 2023-02-18 10:01:44,104 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea., pid=6, masterSystemTime=1676714504071 2023-02-18 10:01:44,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:44,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c9c58b69a75c1f8e2aa25775532d5cea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:44,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:44,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714504107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714504107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714504107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714504107"}]},"ts":"1676714504107"} 2023-02-18 10:01:44,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:44,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c9c58b69a75c1f8e2aa25775532d5cea, server=jenkins-hbase4.apache.org,38851,1676714503149 in 190 msec 2023-02-18 10:01:44,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:44,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c9c58b69a75c1f8e2aa25775532d5cea, ASSIGN in 347 msec 2023-02-18 10:01:44,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:44,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714504115"}]},"ts":"1676714504115"} 2023-02-18 10:01:44,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:44,121 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:44,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 384 msec 2023-02-18 10:01:44,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:44,140 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:44,140 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:44,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:44,144 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:44,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:44,159 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:44,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 16 msec 2023-02-18 10:01:44,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:44,178 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:44,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-18 10:01:44,192 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:44,195 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:44,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.008sec 2023-02-18 10:01:44,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:44,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:44,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:44,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41123,1676714503107-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:44,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41123,1676714503107-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:44,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:44,281 DEBUG [Listener at localhost/37715] zookeeper.ReadOnlyZKClient(139): Connect 0x0ed6e015 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:44,284 DEBUG [Listener at localhost/37715] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c8fd8d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:44,286 DEBUG [hconnection-0x5414851d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:44,287 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:44,288 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:44,288 DEBUG [Listener at localhost/37715] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:44,290 DEBUG [Listener at localhost/37715] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:44,292 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37678, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:44,292 INFO [Listener at localhost/37715] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:44,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:44,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:44,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:37678 deadline: 1676714564292, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:44,293 INFO [Listener at localhost/37715] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 10:01:44,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:44,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:44,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:44,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-18 10:01:44,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:44,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:44,299 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,299 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b empty. 2023-02-18 10:01:44,299 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,299 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-18 10:01:44,309 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:44,310 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => bb0a9836deb3b5761ee43a2c2fa43f1b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp 2023-02-18 10:01:44,315 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:44,315 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing bb0a9836deb3b5761ee43a2c2fa43f1b, disabling compactions & flushes 2023-02-18 10:01:44,315 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,315 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,315 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. after waiting 0 ms 2023-02-18 10:01:44,315 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,315 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,315 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for bb0a9836deb3b5761ee43a2c2fa43f1b: 2023-02-18 10:01:44,317 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:44,318 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676714504317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714504317"}]},"ts":"1676714504317"} 2023-02-18 10:01:44,319 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:44,319 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:44,319 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714504319"}]},"ts":"1676714504319"} 2023-02-18 10:01:44,320 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-18 10:01:44,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:44,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:44,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:44,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:44,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, ASSIGN}] 2023-02-18 10:01:44,332 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, ASSIGN 2023-02-18 10:01:44,332 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45081,1676714503167; forceNewPlan=false, retain=false 2023-02-18 10:01:44,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:44,475 INFO [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45081%2C1676714503167, suffix=, logDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,45081,1676714503167, archiveDir=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/oldWALs, maxLogs=32 2023-02-18 10:01:44,483 INFO [jenkins-hbase4:41123] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:44,483 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bb0a9836deb3b5761ee43a2c2fa43f1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:44,483 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676714504483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714504483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714504483"}]},"ts":"1676714504483"} 2023-02-18 10:01:44,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bb0a9836deb3b5761ee43a2c2fa43f1b, server=jenkins-hbase4.apache.org,45081,1676714503167}] 2023-02-18 10:01:44,490 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK] 2023-02-18 10:01:44,490 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK] 2023-02-18 10:01:44,492 INFO [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,45081,1676714503167/jenkins-hbase4.apache.org%2C45081%2C1676714503167.1676714504475 2023-02-18 10:01:44,496 DEBUG [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44461,DS-6dcbf9f0-f461-4ef3-bb0b-87e50f8aca63,DISK], DatanodeInfoWithStorage[127.0.0.1:46317,DS-dbd1f8c8-5348-45e7-999f-8bf6bdc5283d,DISK]] 2023-02-18 10:01:44,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:44,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bb0a9836deb3b5761ee43a2c2fa43f1b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:44,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:44,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,641 INFO [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,643 DEBUG [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1 2023-02-18 10:01:44,643 DEBUG [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1 2023-02-18 10:01:44,643 INFO [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb0a9836deb3b5761ee43a2c2fa43f1b columnFamilyName f1 2023-02-18 10:01:44,643 INFO [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] regionserver.HStore(310): Store=bb0a9836deb3b5761ee43a2c2fa43f1b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:44,643 INFO [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,644 DEBUG [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2 2023-02-18 10:01:44,644 DEBUG [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2 2023-02-18 10:01:44,645 INFO [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb0a9836deb3b5761ee43a2c2fa43f1b columnFamilyName f2 2023-02-18 10:01:44,645 INFO [StoreOpener-bb0a9836deb3b5761ee43a2c2fa43f1b-1] regionserver.HStore(310): Store=bb0a9836deb3b5761ee43a2c2fa43f1b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:44,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:44,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:44,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:44,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bb0a9836deb3b5761ee43a2c2fa43f1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60174853, jitterRate=-0.10332481563091278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:44,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bb0a9836deb3b5761ee43a2c2fa43f1b: 2023-02-18 10:01:44,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b., pid=12, masterSystemTime=1676714504637 2023-02-18 10:01:44,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:44,652 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bb0a9836deb3b5761ee43a2c2fa43f1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:44,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676714504652"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714504652"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714504652"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714504652"}]},"ts":"1676714504652"} 2023-02-18 10:01:44,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 10:01:44,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bb0a9836deb3b5761ee43a2c2fa43f1b, server=jenkins-hbase4.apache.org,45081,1676714503167 in 169 msec 2023-02-18 10:01:44,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 10:01:44,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, ASSIGN in 325 msec 2023-02-18 10:01:44,657 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:44,657 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714504657"}]},"ts":"1676714504657"} 2023-02-18 10:01:44,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-18 10:01:44,660 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:44,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 365 msec 2023-02-18 10:01:44,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:44,902 INFO [Listener at localhost/37715] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-18 10:01:44,903 DEBUG [Listener at localhost/37715] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-18 10:01:44,903 INFO [Listener at localhost/37715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:44,904 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-18 10:01:44,905 INFO [Listener at localhost/37715] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:44,905 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-18 10:01:44,905 INFO [Listener at localhost/37715] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:44,938 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45081] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,031 INFO [Listener at localhost/37715] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:45,031 INFO [Listener at localhost/37715] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:45,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 10:01:45,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714505033 (current time:1676714505033). 2023-02-18 10:01:45,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:45,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] zookeeper.ReadOnlyZKClient(139): Connect 0x0d26c983 to 127.0.0.1:59115 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66818f75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:45,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:45,039 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d26c983 to 127.0.0.1:59115 2023-02-18 10:01:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:45,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 10:01:45,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 10:01:45,043 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 10:01:45,044 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676715105044 2023-02-18 10:01:45,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 10:01:45,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,045 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:45,046 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:45,046 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 10:01:45,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 10:01:45,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-18 10:01:45,048 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 10:01:45,049 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676715105049 2023-02-18 10:01:45,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-18 10:01:45,061 INFO [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-18 10:01:45,061 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:45,062 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-18 10:01:45,062 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-18 10:01:45,063 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,063 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,065 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:45,065 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:45,065 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:45,066 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,066 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-18 10:01:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-18 10:01:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-18 10:01:45,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-18 10:01:45,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 10:01:45,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 10:01:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 10:01:45,073 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 10:01:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 10:01:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45081,1676714503167' joining acquired barrier for procedure (foo) in zk 2023-02-18 10:01:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 10:01:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 10:01:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 10:01:45,075 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38851,1676714503149' joining acquired barrier for procedure (foo) in zk 2023-02-18 10:01:45,076 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,076 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,077 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:45,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45081,1676714503167' joining acquired barrier for procedure 'foo' on coordinator 2023-02-18 10:01:45,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67622354[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:45,079 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-18 10:01:45,079 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,080 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 10:01:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 10:01:45,080 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 10:01:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38851,1676714503149' in zk 2023-02-18 10:01:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 10:01:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:45,080 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,080 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. started... 2023-02-18 10:01:45,080 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bb0a9836deb3b5761ee43a2c2fa43f1b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 10:01:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 10:01:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 10:01:45,094 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f1/f2fea87e484f45199d39caa0daf73759 2023-02-18 10:01:45,109 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f2/6baf14d1eb734556b06f6fbc8a19fb59 2023-02-18 10:01:45,113 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f1/f2fea87e484f45199d39caa0daf73759 as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759 2023-02-18 10:01:45,116 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:45,117 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f2/6baf14d1eb734556b06f6fbc8a19fb59 as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59 2023-02-18 10:01:45,121 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:45,122 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bb0a9836deb3b5761ee43a2c2fa43f1b in 42ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:45,122 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bb0a9836deb3b5761ee43a2c2fa43f1b: 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.' region-info for snapshot=foo 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759] hfiles 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759 for snapshot=foo 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59] hfiles 2023-02-18 10:01:45,123 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59 for snapshot=foo 2023-02-18 10:01:45,129 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. completed. 2023-02-18 10:01:45,129 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 10:01:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 10:01:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 10:01:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45081,1676714503167' in zk 2023-02-18 10:01:45,131 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 10:01:45,131 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:45,131 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 10:01:45,132 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45081,1676714503167': 2023-02-18 10:01:45,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45081,1676714503167' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-18 10:01:45,136 INFO [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-18 10:01:45,136 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:45,136 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:45,136 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-18 10:01:45,136 INFO [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:45,138 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:45,138 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:45,139 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,140 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,143 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:45,143 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 10:01:45,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,146 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:45,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-18 10:01:45,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:45,148 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:45,150 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,150 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:45,150 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 10:01:45,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,150 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:45,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 10:01:45,151 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 10:01:45,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-18 10:01:45,151 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:45,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-18 10:01:45,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:45,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:45,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:45,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.hbase-snapshot/.tmp/foo 2023-02-18 10:01:45,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.hbase-snapshot/.tmp/foo to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.hbase-snapshot/foo 2023-02-18 10:01:45,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-18 10:01:45,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.hbase-snapshot/.tmp/foo 2023-02-18 10:01:45,201 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.hbase-snapshot/.tmp/foo 2023-02-18 10:01:45,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676714505044Consolidate snapshot: foo at 1676714505151 (+107 ms)Loading Region manifests for foo at 1676714505151Writing data manifest for foo at 1676714505154 (+3 ms)Verifying snapshot: foo at 1676714505175 (+21 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676714505201 (+26 ms) 2023-02-18 10:01:45,203 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 10:01:45,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 158 msec 2023-02-18 10:01:45,348 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:45,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-18 10:01:45,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:45,349 INFO [Listener at localhost/37715] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:45,353 INFO [Listener at localhost/37715] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:45,357 INFO [Listener at localhost/37715] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:45,385 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45081] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,491 INFO [Listener at localhost/37715] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:45,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:45,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,498 INFO [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 10:01:45,498 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:45,499 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-18 10:01:45,499 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-18 10:01:45,499 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,499 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,500 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:45,500 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:45,500 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:45,501 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,501 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-18 10:01:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38851,1676714503149' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 10:01:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:45,505 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,505 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. started... 2023-02-18 10:01:45,506 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bb0a9836deb3b5761ee43a2c2fa43f1b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 10:01:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,507 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,507 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:45,519 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f1/d5bfc45d60ad4dd2bdcfb657acfab458 2023-02-18 10:01:45,536 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f2/5ed10474e2054074b4a4fc7be2b5fc3c 2023-02-18 10:01:45,541 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f1/d5bfc45d60ad4dd2bdcfb657acfab458 as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/d5bfc45d60ad4dd2bdcfb657acfab458 2023-02-18 10:01:45,545 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/d5bfc45d60ad4dd2bdcfb657acfab458, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:45,546 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/.tmp/f2/5ed10474e2054074b4a4fc7be2b5fc3c as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/5ed10474e2054074b4a4fc7be2b5fc3c 2023-02-18 10:01:45,550 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/5ed10474e2054074b4a4fc7be2b5fc3c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:45,560 INFO [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bb0a9836deb3b5761ee43a2c2fa43f1b in 54ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:45,561 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bb0a9836deb3b5761ee43a2c2fa43f1b: 2023-02-18 10:01:45,561 DEBUG [rs(jenkins-hbase4.apache.org,45081,1676714503167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,561 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 10:01:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 10:01:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-18 10:01:45,562 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45081,1676714503167' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-18 10:01:45,563 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,563 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:45,563 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,564 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:45,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45081,1676714503167' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-18 10:01:45,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@635dab60[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:45,565 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-18 10:01:45,566 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-18 10:01:45,572 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,572 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:45,571 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-18 10:01:45,572 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-18 10:01:45,572 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-18 10:01:45,572 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45081,1676714503167' in zk 2023-02-18 10:01:45,572 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,38851,1676714503149' in zk 2023-02-18 10:01:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-18 10:01:45,573 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-18 10:01:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:45,573 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:45,574 DEBUG [member: 'jenkins-hbase4.apache.org,38851,1676714503149' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-18 10:01:45,574 DEBUG [member: 'jenkins-hbase4.apache.org,45081,1676714503167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-18 10:01:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,45081,1676714503167': 2023-02-18 10:01:45,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45081,1676714503167' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-18 10:01:45,578 INFO [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-18 10:01:45,578 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:45,578 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:45,578 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,578 INFO [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:45,580 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:45,580 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:45,580 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,581 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:45,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:45,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,590 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,590 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:45,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 10:01:45,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:45,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:45,593 DEBUG [(jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:45,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:45,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:45,593 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,594 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:45,594 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,594 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:45,694 DEBUG [Listener at localhost/37715] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:45,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:45,700 INFO [Listener at localhost/37715] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676714505033 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:45,700 DEBUG [Listener at localhost/37715] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43855/user/jenkins/test-data/142615b4-23d7-2b88-938a-ec0b831523fd/foo/6a3e7325-a9c7-4564-889e-ee6cc9b60271/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,700 INFO [Listener at localhost/37715] snapshot.RestoreSnapshotHelper(239): region to add: bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:45,700 INFO [Listener at localhost/37715] snapshot.RestoreSnapshotHelper(585): clone region=bb0a9836deb3b5761ee43a2c2fa43f1b as bb0a9836deb3b5761ee43a2c2fa43f1b in snapshot foo 2023-02-18 10:01:45,701 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bb0a9836deb3b5761ee43a2c2fa43f1b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43855/user/jenkins/test-data/142615b4-23d7-2b88-938a-ec0b831523fd/foo/6a3e7325-a9c7-4564-889e-ee6cc9b60271 2023-02-18 10:01:45,726 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:45,726 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f2fea87e484f45199d39caa0daf73759 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,729 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6baf14d1eb734556b06f6fbc8a19fb59 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,731 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bb0a9836deb3b5761ee43a2c2fa43f1b, disabling compactions & flushes 2023-02-18 10:01:45,731 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,731 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,731 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. after waiting 0 ms 2023-02-18 10:01:45,731 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,731 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,731 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bb0a9836deb3b5761ee43a2c2fa43f1b: 2023-02-18 10:01:45,733 INFO [Listener at localhost/37715] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676714505033 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:45,734 DEBUG [Listener at localhost/37715] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43855/user/jenkins/test-data/142615b4-23d7-2b88-938a-ec0b831523fd/foo/6a3e7325-a9c7-4564-889e-ee6cc9b60271 2023-02-18 10:01:45,734 DEBUG [Listener at localhost/37715] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43855/user/jenkins/test-data/142615b4-23d7-2b88-938a-ec0b831523fd/foo/6a3e7325-a9c7-4564-889e-ee6cc9b60271 2023-02-18 10:01:45,734 DEBUG [Listener at localhost/37715] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:45,735 DEBUG [Listener at localhost/37715] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:45,735 DEBUG [Listener at localhost/37715] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-18 10:01:45,736 DEBUG [Listener at localhost/37715] util.CommonFSUtils(699): |----------bb0a9836deb3b5761ee43a2c2fa43f1b/ 2023-02-18 10:01:45,736 DEBUG [Listener at localhost/37715] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:45,736 DEBUG [Listener at localhost/37715] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:45,737 DEBUG [Listener at localhost/37715] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=bb0a9836deb3b5761ee43a2c2fa43f1b-f2fea87e484f45199d39caa0daf73759 2023-02-18 10:01:45,738 DEBUG [Listener at localhost/37715] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:45,738 DEBUG [Listener at localhost/37715] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=bb0a9836deb3b5761ee43a2c2fa43f1b-6baf14d1eb734556b06f6fbc8a19fb59 hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/d5bfc45d60ad4dd2bdcfb657acfab458 hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759 hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/5ed10474e2054074b4a4fc7be2b5fc3c hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59 2023-02-18 10:01:45,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-18 10:01:45,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-18 10:01:45,749 INFO [Listener at localhost/37715] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:45,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714505752"}]},"ts":"1676714505752"} 2023-02-18 10:01:45,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-18 10:01:45,756 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-18 10:01:45,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, UNASSIGN}] 2023-02-18 10:01:45,759 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, UNASSIGN 2023-02-18 10:01:45,760 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bb0a9836deb3b5761ee43a2c2fa43f1b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:45,760 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676714505760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714505760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714505760"}]},"ts":"1676714505760"} 2023-02-18 10:01:45,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bb0a9836deb3b5761ee43a2c2fa43f1b, server=jenkins-hbase4.apache.org,45081,1676714503167}] 2023-02-18 10:01:45,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:45,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:45,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bb0a9836deb3b5761ee43a2c2fa43f1b, disabling compactions & flushes 2023-02-18 10:01:45,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. after waiting 0 ms 2023-02-18 10:01:45,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:45,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b. 2023-02-18 10:01:45,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bb0a9836deb3b5761ee43a2c2fa43f1b: 2023-02-18 10:01:45,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:45,919 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bb0a9836deb3b5761ee43a2c2fa43f1b, regionState=CLOSED 2023-02-18 10:01:45,919 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676714505919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714505919"}]},"ts":"1676714505919"} 2023-02-18 10:01:45,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 10:01:45,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bb0a9836deb3b5761ee43a2c2fa43f1b, server=jenkins-hbase4.apache.org,45081,1676714503167 in 159 msec 2023-02-18 10:01:45,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 10:01:45,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bb0a9836deb3b5761ee43a2c2fa43f1b, UNASSIGN in 166 msec 2023-02-18 10:01:45,925 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714505925"}]},"ts":"1676714505925"} 2023-02-18 10:01:45,927 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-18 10:01:45,929 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-18 10:01:45,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 181 msec 2023-02-18 10:01:46,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:46,055 INFO [Listener at localhost/37715] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-18 10:01:46,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,059 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,059 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:46,062 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:46,064 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1, FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2, FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/recovered.edits] 2023-02-18 10:01:46,066 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/d5bfc45d60ad4dd2bdcfb657acfab458 to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/d5bfc45d60ad4dd2bdcfb657acfab458 2023-02-18 10:01:46,067 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759 to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f1/f2fea87e484f45199d39caa0daf73759 2023-02-18 10:01:46,070 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/5ed10474e2054074b4a4fc7be2b5fc3c to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/5ed10474e2054074b4a4fc7be2b5fc3c 2023-02-18 10:01:46,070 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59 to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/f2/6baf14d1eb734556b06f6fbc8a19fb59 2023-02-18 10:01:46,077 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/recovered.edits/12.seqid to hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b/recovered.edits/12.seqid 2023-02-18 10:01:46,077 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bb0a9836deb3b5761ee43a2c2fa43f1b 2023-02-18 10:01:46,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-18 10:01:46,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,080 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-18 10:01:46,082 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-18 10:01:46,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-18 10:01:46,085 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714506085"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:46,086 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 10:01:46,086 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bb0a9836deb3b5761ee43a2c2fa43f1b, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676714504295.bb0a9836deb3b5761ee43a2c2fa43f1b.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 10:01:46,086 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-18 10:01:46,086 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676714506086"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:46,088 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-18 10:01:46,089 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 10:01:46,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 33 msec 2023-02-18 10:01:46,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41123] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:46,161 INFO [Listener at localhost/37715] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-18 10:01:46,161 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:46,161 INFO [Listener at localhost/37715] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:46,162 DEBUG [Listener at localhost/37715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ed6e015 to 127.0.0.1:59115 2023-02-18 10:01:46,162 DEBUG [Listener at localhost/37715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,162 DEBUG [Listener at localhost/37715] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:46,162 DEBUG [Listener at localhost/37715] util.JVMClusterUtil(257): Found active master hash=1194597527, stopped=false 2023-02-18 10:01:46,162 INFO [Listener at localhost/37715] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:46,168 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:46,168 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:46,168 INFO [Listener at localhost/37715] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:46,168 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:46,168 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:46,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:46,169 DEBUG [Listener at localhost/37715] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cda01ec to 127.0.0.1:59115 2023-02-18 10:01:46,169 DEBUG [Listener at localhost/37715] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:46,170 INFO [Listener at localhost/37715] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38851,1676714503149' ***** 2023-02-18 10:01:46,170 INFO [Listener at localhost/37715] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:46,170 INFO [Listener at localhost/37715] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45081,1676714503167' ***** 2023-02-18 10:01:46,170 INFO [Listener at localhost/37715] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:46,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:46,170 INFO [RS:0;jenkins-hbase4:38851] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:46,170 INFO [RS:1;jenkins-hbase4:45081] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:46,170 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:46,170 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:46,170 INFO [RS:0;jenkins-hbase4:38851] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:46,170 INFO [RS:1;jenkins-hbase4:45081] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:46,172 INFO [RS:0;jenkins-hbase4:38851] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:46,172 INFO [RS:1;jenkins-hbase4:45081] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:46,172 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(3304): Received CLOSE for c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:46,172 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:46,172 DEBUG [RS:1;jenkins-hbase4:45081] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43cf695a to 127.0.0.1:59115 2023-02-18 10:01:46,172 DEBUG [RS:1;jenkins-hbase4:45081] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,172 INFO [RS:1;jenkins-hbase4:45081] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:46,172 INFO [RS:1;jenkins-hbase4:45081] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:46,172 INFO [RS:1;jenkins-hbase4:45081] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:46,172 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:46,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c9c58b69a75c1f8e2aa25775532d5cea, disabling compactions & flushes 2023-02-18 10:01:46,172 DEBUG [RS:0;jenkins-hbase4:38851] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bb48ac6 to 127.0.0.1:59115 2023-02-18 10:01:46,172 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:46,172 DEBUG [RS:0;jenkins-hbase4:38851] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:46,173 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:46,173 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:46,173 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. after waiting 0 ms 2023-02-18 10:01:46,173 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1479): Online Regions={c9c58b69a75c1f8e2aa25775532d5cea=hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea.} 2023-02-18 10:01:46,173 DEBUG [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:46,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:46,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c9c58b69a75c1f8e2aa25775532d5cea 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:46,173 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1505): Waiting on c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:46,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:46,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-18 10:01:46,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/.tmp/info/43c58a312c9742c1954b8406eb38e913 2023-02-18 10:01:46,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43c58a312c9742c1954b8406eb38e913 2023-02-18 10:01:46,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/.tmp/rep_barrier/c7c2aca27df54cbebbd1c95c1b52ed4d 2023-02-18 10:01:46,203 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7c2aca27df54cbebbd1c95c1b52ed4d 2023-02-18 10:01:46,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/.tmp/table/513f72e2ed5140788348ff0884210710 2023-02-18 10:01:46,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 513f72e2ed5140788348ff0884210710 2023-02-18 10:01:46,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/.tmp/info/43c58a312c9742c1954b8406eb38e913 as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/info/43c58a312c9742c1954b8406eb38e913 2023-02-18 10:01:46,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43c58a312c9742c1954b8406eb38e913 2023-02-18 10:01:46,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/info/43c58a312c9742c1954b8406eb38e913, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 10:01:46,219 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/.tmp/rep_barrier/c7c2aca27df54cbebbd1c95c1b52ed4d as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/rep_barrier/c7c2aca27df54cbebbd1c95c1b52ed4d 2023-02-18 10:01:46,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7c2aca27df54cbebbd1c95c1b52ed4d 2023-02-18 10:01:46,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/rep_barrier/c7c2aca27df54cbebbd1c95c1b52ed4d, entries=1, sequenceid=21, filesize=5.1 K 2023-02-18 10:01:46,223 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/.tmp/table/513f72e2ed5140788348ff0884210710 as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/table/513f72e2ed5140788348ff0884210710 2023-02-18 10:01:46,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 513f72e2ed5140788348ff0884210710 2023-02-18 10:01:46,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/table/513f72e2ed5140788348ff0884210710, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 10:01:46,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 55ms, sequenceid=21, compaction requested=false 2023-02-18 10:01:46,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 10:01:46,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:46,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:46,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:46,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:46,244 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:46,245 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:46,373 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45081,1676714503167; all regions closed. 2023-02-18 10:01:46,373 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1505): Waiting on c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:46,378 DEBUG [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/oldWALs 2023-02-18 10:01:46,378 INFO [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45081%2C1676714503167.meta:.meta(num 1676714503686) 2023-02-18 10:01:46,381 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/WALs/jenkins-hbase4.apache.org,45081,1676714503167/jenkins-hbase4.apache.org%2C45081%2C1676714503167.1676714504475 not finished, retry = 0 2023-02-18 10:01:46,440 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 10:01:46,440 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 10:01:46,442 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 10:01:46,442 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 10:01:46,483 DEBUG [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/oldWALs 2023-02-18 10:01:46,483 INFO [RS:1;jenkins-hbase4:45081] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45081%2C1676714503167:(num 1676714504475) 2023-02-18 10:01:46,483 DEBUG [RS:1;jenkins-hbase4:45081] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,483 INFO [RS:1;jenkins-hbase4:45081] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:46,483 INFO [RS:1;jenkins-hbase4:45081] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:46,483 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:46,484 INFO [RS:1;jenkins-hbase4:45081] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45081 2023-02-18 10:01:46,487 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:46,487 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:46,487 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45081,1676714503167 2023-02-18 10:01:46,487 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21da08a5 rejected from java.util.concurrent.ThreadPoolExecutor@25e59846[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,487 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:46,487 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:46,487 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20a3d9f7 rejected from java.util.concurrent.ThreadPoolExecutor@25e59846[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,487 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45081,1676714503167] 2023-02-18 10:01:46,487 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45081,1676714503167; numProcessing=1 2023-02-18 10:01:46,489 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45081,1676714503167 already deleted, retry=false 2023-02-18 10:01:46,489 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45081,1676714503167 expired; onlineServers=1 2023-02-18 10:01:46,573 DEBUG [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1505): Waiting on c9c58b69a75c1f8e2aa25775532d5cea 2023-02-18 10:01:46,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/.tmp/info/6e0dbc4b61d34a1095748446744bb00b 2023-02-18 10:01:46,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/.tmp/info/6e0dbc4b61d34a1095748446744bb00b as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/info/6e0dbc4b61d34a1095748446744bb00b 2023-02-18 10:01:46,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/info/6e0dbc4b61d34a1095748446744bb00b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:46,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c9c58b69a75c1f8e2aa25775532d5cea in 425ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:46,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/data/hbase/namespace/c9c58b69a75c1f8e2aa25775532d5cea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:46,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:46,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c9c58b69a75c1f8e2aa25775532d5cea: 2023-02-18 10:01:46,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714503737.c9c58b69a75c1f8e2aa25775532d5cea. 2023-02-18 10:01:46,664 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:46,664 INFO [RS:1;jenkins-hbase4:45081] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45081,1676714503167; zookeeper connection closed. 2023-02-18 10:01:46,664 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58e3e7a1 rejected from java.util.concurrent.ThreadPoolExecutor@25e59846[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,664 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:45081-0x10066e0d5750002, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:46,664 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e9af05e rejected from java.util.concurrent.ThreadPoolExecutor@25e59846[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,664 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@666bd66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@666bd66 2023-02-18 10:01:46,774 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38851,1676714503149; all regions closed. 2023-02-18 10:01:46,778 DEBUG [RS:0;jenkins-hbase4:38851] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/oldWALs 2023-02-18 10:01:46,778 INFO [RS:0;jenkins-hbase4:38851] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38851%2C1676714503149:(num 1676714504078) 2023-02-18 10:01:46,778 DEBUG [RS:0;jenkins-hbase4:38851] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,778 INFO [RS:0;jenkins-hbase4:38851] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:46,778 INFO [RS:0;jenkins-hbase4:38851] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:46,778 INFO [RS:0;jenkins-hbase4:38851] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:46,778 INFO [RS:0;jenkins-hbase4:38851] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:46,778 INFO [RS:0;jenkins-hbase4:38851] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:46,779 INFO [RS:0;jenkins-hbase4:38851] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38851 2023-02-18 10:01:46,779 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:46,781 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38851,1676714503149 2023-02-18 10:01:46,781 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:46,781 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b7a2e96 rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,782 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38851,1676714503149] 2023-02-18 10:01:46,782 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38851,1676714503149; numProcessing=2 2023-02-18 10:01:46,784 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38851,1676714503149 already deleted, retry=false 2023-02-18 10:01:46,784 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38851,1676714503149 expired; onlineServers=0 2023-02-18 10:01:46,784 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41123,1676714503107' ***** 2023-02-18 10:01:46,784 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:46,785 DEBUG [M:0;jenkins-hbase4:41123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@430b80a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:46,785 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41123,1676714503107 2023-02-18 10:01:46,785 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41123,1676714503107; all regions closed. 2023-02-18 10:01:46,785 DEBUG [M:0;jenkins-hbase4:41123] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:46,785 DEBUG [M:0;jenkins-hbase4:41123] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:46,785 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:46,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714503292] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714503292,5,FailOnTimeoutGroup] 2023-02-18 10:01:46,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714503292] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714503292,5,FailOnTimeoutGroup] 2023-02-18 10:01:46,785 DEBUG [M:0;jenkins-hbase4:41123] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:46,786 INFO [M:0;jenkins-hbase4:41123] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:46,786 INFO [M:0;jenkins-hbase4:41123] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:46,786 INFO [M:0;jenkins-hbase4:41123] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:46,786 DEBUG [M:0;jenkins-hbase4:41123] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:46,786 INFO [M:0;jenkins-hbase4:41123] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:46,787 ERROR [M:0;jenkins-hbase4:41123] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 10:01:46,787 INFO [M:0;jenkins-hbase4:41123] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:46,787 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:46,787 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:46,787 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:46,787 DEBUG [M:0;jenkins-hbase4:41123] zookeeper.ZKUtil(398): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:46,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:46,787 WARN [M:0;jenkins-hbase4:41123] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:46,788 INFO [M:0;jenkins-hbase4:41123] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:46,788 INFO [M:0;jenkins-hbase4:41123] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:46,788 DEBUG [M:0;jenkins-hbase4:41123] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:46,788 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:46,788 DEBUG [M:0;jenkins-hbase4:41123] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:46,788 DEBUG [M:0;jenkins-hbase4:41123] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:46,788 DEBUG [M:0;jenkins-hbase4:41123] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:46,788 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.69 KB heapSize=67.70 KB 2023-02-18 10:01:46,796 INFO [M:0;jenkins-hbase4:41123] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/560930430d50449c869826f33e97bbca 2023-02-18 10:01:46,799 DEBUG [M:0;jenkins-hbase4:41123] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/560930430d50449c869826f33e97bbca as hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/560930430d50449c869826f33e97bbca 2023-02-18 10:01:46,803 INFO [M:0;jenkins-hbase4:41123] regionserver.HStore(1080): Added hdfs://localhost:43855/user/jenkins/test-data/9c080e7f-c236-7e84-3086-c387db792dd5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/560930430d50449c869826f33e97bbca, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 10:01:46,804 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegion(2947): Finished flush of dataSize ~56.69 KB/58051, heapSize ~67.68 KB/69304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-18 10:01:46,804 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:46,804 DEBUG [M:0;jenkins-hbase4:41123] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:46,806 INFO [M:0;jenkins-hbase4:41123] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:46,806 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:46,807 INFO [M:0;jenkins-hbase4:41123] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41123 2023-02-18 10:01:46,808 DEBUG [M:0;jenkins-hbase4:41123] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41123,1676714503107 already deleted, retry=false 2023-02-18 10:01:46,882 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:46,882 INFO [RS:0;jenkins-hbase4:38851] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38851,1676714503149; zookeeper connection closed. 2023-02-18 10:01:46,882 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21935aec rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,882 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): regionserver:38851-0x10066e0d5750001, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:46,882 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59f9ee3c rejected from java.util.concurrent.ThreadPoolExecutor@f45bb21[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,882 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15e84deb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15e84deb 2023-02-18 10:01:46,882 INFO [Listener at localhost/37715] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:46,932 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 10:01:46,982 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:46,982 INFO [M:0;jenkins-hbase4:41123] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41123,1676714503107; zookeeper connection closed. 2023-02-18 10:01:46,982 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4439f3e rejected from java.util.concurrent.ThreadPoolExecutor@7c0b6e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,983 DEBUG [Listener at localhost/37715-EventThread] zookeeper.ZKWatcher(600): master:41123-0x10066e0d5750000, quorum=127.0.0.1:59115, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:46,983 ERROR [Listener at localhost/37715-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cd39924 rejected from java.util.concurrent.ThreadPoolExecutor@7c0b6e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:46,983 WARN [Listener at localhost/37715] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:46,986 INFO [Listener at localhost/37715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:47,090 WARN [BP-974011906-172.31.14.131-1676714502521 heartbeating to localhost/127.0.0.1:43855] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:47,092 WARN [BP-974011906-172.31.14.131-1676714502521 heartbeating to localhost/127.0.0.1:43855] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-974011906-172.31.14.131-1676714502521 (Datanode Uuid 87c91607-482d-4b43-bd30-438df4ff4610) service to localhost/127.0.0.1:43855 2023-02-18 10:01:47,093 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/dfs/data/data3/current/BP-974011906-172.31.14.131-1676714502521] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:47,093 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/dfs/data/data4/current/BP-974011906-172.31.14.131-1676714502521] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:47,094 WARN [Listener at localhost/37715] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:47,103 INFO [Listener at localhost/37715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:47,208 WARN [BP-974011906-172.31.14.131-1676714502521 heartbeating to localhost/127.0.0.1:43855] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:47,208 WARN [BP-974011906-172.31.14.131-1676714502521 heartbeating to localhost/127.0.0.1:43855] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-974011906-172.31.14.131-1676714502521 (Datanode Uuid 9533fe54-337f-45b5-b311-024cd87ef610) service to localhost/127.0.0.1:43855 2023-02-18 10:01:47,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/dfs/data/data1/current/BP-974011906-172.31.14.131-1676714502521] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:47,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/cluster_b92e57bf-1bfd-85dd-891d-f22d0fe3374a/dfs/data/data2/current/BP-974011906-172.31.14.131-1676714502521] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:47,219 INFO [Listener at localhost/37715] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:47,331 INFO [Listener at localhost/37715] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:47,345 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:47,357 INFO [Listener at localhost/37715] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=271 (was 251) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:43855 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37715 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41123,1676714503107)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:43855 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:43855 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:43855 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43855 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:43855 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:43855 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=580 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 204), ProcessCount=170 (was 170), AvailableMemoryMB=8548 (was 8623) 2023-02-18 10:01:47,369 INFO [Listener at localhost/37715] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=271, OpenFileDescriptor=580, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=170, AvailableMemoryMB=8548 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/hadoop.log.dir so I do NOT create it in target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60 2023-02-18 10:01:47,379 WARN [Listener at localhost/37715] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/hadoop.tmp.dir so I do NOT create it in target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60 2023-02-18 10:01:47,379 WARN [Listener at localhost/37715] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd325d9b-a4d2-17ca-4213-3b46cd0fd6ab/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 10:01:47,379 DEBUG [Listener at localhost/37715] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986, deleteOnExit=true 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/test.cache.data in system properties and HBase conf 2023-02-18 10:01:47,379 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/hadoop.log.dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 10:01:47,380 DEBUG [Listener at localhost/37715] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:47,380 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/nfs.dump.dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/java.io.tmpdir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 10:01:47,381 INFO [Listener at localhost/37715] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 10:01:47,385 WARN [Listener at localhost/37715] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:47,386 WARN [Listener at localhost/37715] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:47,424 WARN [Listener at localhost/37715] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:47,425 INFO [Listener at localhost/37715] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:47,429 INFO [Listener at localhost/37715] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/java.io.tmpdir/Jetty_localhost_43605_hdfs____7b975y/webapp 2023-02-18 10:01:47,528 INFO [Listener at localhost/37715] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43605 2023-02-18 10:01:47,573 WARN [Listener at localhost/37715] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 10:01:47,573 WARN [Listener at localhost/37715] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 10:01:47,615 WARN [Listener at localhost/40077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:47,627 WARN [Listener at localhost/40077] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:47,628 WARN [Listener at localhost/40077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:47,629 INFO [Listener at localhost/40077] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:47,634 INFO [Listener at localhost/40077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/java.io.tmpdir/Jetty_localhost_43155_datanode____hpex09/webapp 2023-02-18 10:01:47,736 INFO [Listener at localhost/40077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43155 2023-02-18 10:01:47,747 WARN [Listener at localhost/45439] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:47,765 WARN [Listener at localhost/45439] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 10:01:47,767 WARN [Listener at localhost/45439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 10:01:47,768 INFO [Listener at localhost/45439] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 10:01:47,774 INFO [Listener at localhost/45439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/java.io.tmpdir/Jetty_localhost_38717_datanode____.fmdam9/webapp 2023-02-18 10:01:47,851 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d9dc07396dfb978: Processing first storage report for DS-865e3675-831c-44d8-b0c4-48b407d31eec from datanode cf553ca1-5a40-491d-a201-241c708ba16c 2023-02-18 10:01:47,851 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d9dc07396dfb978: from storage DS-865e3675-831c-44d8-b0c4-48b407d31eec node DatanodeRegistration(127.0.0.1:40685, datanodeUuid=cf553ca1-5a40-491d-a201-241c708ba16c, infoPort=33899, infoSecurePort=0, ipcPort=45439, storageInfo=lv=-57;cid=testClusterID;nsid=561981202;c=1676714507388), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:47,851 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d9dc07396dfb978: Processing first storage report for DS-edafd4a2-adb2-4ff2-b8eb-1412f04178fd from datanode cf553ca1-5a40-491d-a201-241c708ba16c 2023-02-18 10:01:47,851 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d9dc07396dfb978: from storage DS-edafd4a2-adb2-4ff2-b8eb-1412f04178fd node DatanodeRegistration(127.0.0.1:40685, datanodeUuid=cf553ca1-5a40-491d-a201-241c708ba16c, infoPort=33899, infoSecurePort=0, ipcPort=45439, storageInfo=lv=-57;cid=testClusterID;nsid=561981202;c=1676714507388), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:47,875 INFO [Listener at localhost/45439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38717 2023-02-18 10:01:47,885 WARN [Listener at localhost/39743] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 10:01:47,972 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde4cb71d07bc01f6: Processing first storage report for DS-ef15cd16-2d45-44bc-8349-9b2cda35f640 from datanode f2445601-1dc2-4e98-bc70-4fb0e1bf3022 2023-02-18 10:01:47,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde4cb71d07bc01f6: from storage DS-ef15cd16-2d45-44bc-8349-9b2cda35f640 node DatanodeRegistration(127.0.0.1:33379, datanodeUuid=f2445601-1dc2-4e98-bc70-4fb0e1bf3022, infoPort=39791, infoSecurePort=0, ipcPort=39743, storageInfo=lv=-57;cid=testClusterID;nsid=561981202;c=1676714507388), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:47,972 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde4cb71d07bc01f6: Processing first storage report for DS-db228523-0de5-4dc4-b5ca-69c7ea23c798 from datanode f2445601-1dc2-4e98-bc70-4fb0e1bf3022 2023-02-18 10:01:47,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde4cb71d07bc01f6: from storage DS-db228523-0de5-4dc4-b5ca-69c7ea23c798 node DatanodeRegistration(127.0.0.1:33379, datanodeUuid=f2445601-1dc2-4e98-bc70-4fb0e1bf3022, infoPort=39791, infoSecurePort=0, ipcPort=39743, storageInfo=lv=-57;cid=testClusterID;nsid=561981202;c=1676714507388), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 10:01:47,990 DEBUG [Listener at localhost/39743] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60 2023-02-18 10:01:47,992 INFO [Listener at localhost/39743] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/zookeeper_0, clientPort=49179, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 10:01:47,993 INFO [Listener at localhost/39743] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49179 2023-02-18 10:01:47,993 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:47,994 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,004 INFO [Listener at localhost/39743] util.FSUtils(479): Created version file at hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270 with version=8 2023-02-18 10:01:48,005 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,005 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,006 INFO [Listener at localhost/39743] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/hbase-staging 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:48,008 INFO [Listener at localhost/39743] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:48,009 INFO [Listener at localhost/39743] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34329 2023-02-18 10:01:48,009 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,010 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,010 INFO [Listener at localhost/39743] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34329 connecting to ZooKeeper ensemble=127.0.0.1:49179 2023-02-18 10:01:48,016 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:343290x0, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:48,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34329-0x10066e0e89d0000 connected 2023-02-18 10:01:48,034 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:48,034 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:48,035 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:48,035 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34329 2023-02-18 10:01:48,035 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34329 2023-02-18 10:01:48,036 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34329 2023-02-18 10:01:48,036 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34329 2023-02-18 10:01:48,036 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34329 2023-02-18 10:01:48,036 INFO [Listener at localhost/39743] master.HMaster(444): hbase.rootdir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270, hbase.cluster.distributed=false 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:48,048 INFO [Listener at localhost/39743] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:48,049 INFO [Listener at localhost/39743] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37705 2023-02-18 10:01:48,049 INFO [Listener at localhost/39743] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:48,049 DEBUG [Listener at localhost/39743] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:48,050 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,050 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,051 INFO [Listener at localhost/39743] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37705 connecting to ZooKeeper ensemble=127.0.0.1:49179 2023-02-18 10:01:48,055 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:377050x0, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:48,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37705-0x10066e0e89d0001 connected 2023-02-18 10:01:48,057 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:48,058 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:48,058 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:48,059 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37705 2023-02-18 10:01:48,059 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37705 2023-02-18 10:01:48,059 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37705 2023-02-18 10:01:48,060 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37705 2023-02-18 10:01:48,060 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37705 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 10:01:48,071 INFO [Listener at localhost/39743] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 10:01:48,072 INFO [Listener at localhost/39743] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40195 2023-02-18 10:01:48,072 INFO [Listener at localhost/39743] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 10:01:48,072 DEBUG [Listener at localhost/39743] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:48,073 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,073 INFO [Listener at localhost/39743] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,074 INFO [Listener at localhost/39743] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40195 connecting to ZooKeeper ensemble=127.0.0.1:49179 2023-02-18 10:01:48,076 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:401950x0, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 10:01:48,077 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): regionserver:401950x0, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:48,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40195-0x10066e0e89d0002 connected 2023-02-18 10:01:48,077 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:48,078 DEBUG [Listener at localhost/39743] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 10:01:48,078 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40195 2023-02-18 10:01:48,078 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40195 2023-02-18 10:01:48,078 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40195 2023-02-18 10:01:48,079 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40195 2023-02-18 10:01:48,079 DEBUG [Listener at localhost/39743] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40195 2023-02-18 10:01:48,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,081 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:48,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,083 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:48,083 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:48,083 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,083 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:48,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:48,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34329,1676714508007 from backup master directory 2023-02-18 10:01:48,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 10:01:48,088 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,088 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:48,088 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 10:01:48,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/hbase.id with ID: 1e480a76-59a6-4661-9cbf-fbb5c1f2f6fe 2023-02-18 10:01:48,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 10:01:48,105 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x195ccb8d to 127.0.0.1:49179 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:48,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6eedb2aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:48,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:48,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 10:01:48,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:48,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store-tmp 2023-02-18 10:01:48,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:48,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:48,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:48,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:48,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:48,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:48,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:48,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:48,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/WALs/jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34329%2C1676714508007, suffix=, logDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/WALs/jenkins-hbase4.apache.org,34329,1676714508007, archiveDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/oldWALs, maxLogs=10 2023-02-18 10:01:48,142 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK] 2023-02-18 10:01:48,142 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK] 2023-02-18 10:01:48,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/WALs/jenkins-hbase4.apache.org,34329,1676714508007/jenkins-hbase4.apache.org%2C34329%2C1676714508007.1676714508126 2023-02-18 10:01:48,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK], DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK]] 2023-02-18 10:01:48,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:48,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:48,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:48,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:48,147 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:48,148 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 10:01:48,148 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 10:01:48,149 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:48,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:48,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 10:01:48,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:48,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73994101, jitterRate=0.10259802639484406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:48,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:48,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 10:01:48,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 10:01:48,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 10:01:48,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 10:01:48,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 10:01:48,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 10:01:48,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 10:01:48,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 10:01:48,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 10:01:48,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 10:01:48,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 10:01:48,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 10:01:48,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 10:01:48,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 10:01:48,169 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 10:01:48,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 10:01:48,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 10:01:48,172 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:48,172 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:48,172 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,172 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:48,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34329,1676714508007, sessionid=0x10066e0e89d0000, setting cluster-up flag (Was=false) 2023-02-18 10:01:48,177 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 10:01:48,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,183 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 10:01:48,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:48,188 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.hbase-snapshot/.tmp 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:48,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676714538191 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 10:01:48,191 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:48,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,191 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 10:01:48,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 10:01:48,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 10:01:48,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 10:01:48,193 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:48,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 10:01:48,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 10:01:48,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714508193,5,FailOnTimeoutGroup] 2023-02-18 10:01:48,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714508193,5,FailOnTimeoutGroup] 2023-02-18 10:01:48,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 10:01:48,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,199 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:48,199 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:48,199 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270 2023-02-18 10:01:48,204 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:48,205 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:48,206 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/info 2023-02-18 10:01:48,206 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:48,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:48,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:48,207 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:48,208 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,208 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:48,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/table 2023-02-18 10:01:48,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:48,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,209 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740 2023-02-18 10:01:48,210 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740 2023-02-18 10:01:48,211 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:48,212 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:48,213 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:48,213 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69241274, jitterRate=0.03177538514137268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:48,213 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:48,213 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:48,213 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:48,213 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:48,213 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:48,213 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:48,214 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:48,214 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:48,214 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 10:01:48,214 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 10:01:48,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 10:01:48,215 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 10:01:48,216 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 10:01:48,281 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(952): ClusterId : 1e480a76-59a6-4661-9cbf-fbb5c1f2f6fe 2023-02-18 10:01:48,281 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:48,281 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(952): ClusterId : 1e480a76-59a6-4661-9cbf-fbb5c1f2f6fe 2023-02-18 10:01:48,281 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 10:01:48,285 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:48,285 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:48,285 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 10:01:48,285 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 10:01:48,287 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:48,288 DEBUG [RS:0;jenkins-hbase4:37705] zookeeper.ReadOnlyZKClient(139): Connect 0x4f1df2e1 to 127.0.0.1:49179 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:48,288 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 10:01:48,289 DEBUG [RS:1;jenkins-hbase4:40195] zookeeper.ReadOnlyZKClient(139): Connect 0x7a47cfff to 127.0.0.1:49179 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:48,293 DEBUG [RS:0;jenkins-hbase4:37705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41da0572, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:48,293 DEBUG [RS:1;jenkins-hbase4:40195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74802ec7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:48,293 DEBUG [RS:0;jenkins-hbase4:37705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e59991, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:48,293 DEBUG [RS:1;jenkins-hbase4:40195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70bfa48f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:48,302 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40195 2023-02-18 10:01:48,302 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37705 2023-02-18 10:01:48,302 INFO [RS:1;jenkins-hbase4:40195] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:48,302 INFO [RS:1;jenkins-hbase4:40195] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:48,302 INFO [RS:0;jenkins-hbase4:37705] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 10:01:48,302 INFO [RS:0;jenkins-hbase4:37705] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 10:01:48,302 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:48,302 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 10:01:48,302 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34329,1676714508007 with isa=jenkins-hbase4.apache.org/172.31.14.131:40195, startcode=1676714508070 2023-02-18 10:01:48,302 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34329,1676714508007 with isa=jenkins-hbase4.apache.org/172.31.14.131:37705, startcode=1676714508047 2023-02-18 10:01:48,303 DEBUG [RS:1;jenkins-hbase4:40195] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:48,303 DEBUG [RS:0;jenkins-hbase4:37705] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 10:01:48,304 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51567, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:48,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,306 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53215, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 10:01:48,306 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270 2023-02-18 10:01:48,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,306 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40077 2023-02-18 10:01:48,306 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:48,306 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270 2023-02-18 10:01:48,306 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40077 2023-02-18 10:01:48,306 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 10:01:48,307 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:48,310 DEBUG [RS:1;jenkins-hbase4:40195] zookeeper.ZKUtil(162): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37705,1676714508047] 2023-02-18 10:01:48,310 WARN [RS:1;jenkins-hbase4:40195] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:48,310 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40195,1676714508070] 2023-02-18 10:01:48,311 INFO [RS:1;jenkins-hbase4:40195] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:48,311 DEBUG [RS:0;jenkins-hbase4:37705] zookeeper.ZKUtil(162): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,311 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,311 WARN [RS:0;jenkins-hbase4:37705] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 10:01:48,311 INFO [RS:0;jenkins-hbase4:37705] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:48,311 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,316 DEBUG [RS:1;jenkins-hbase4:40195] zookeeper.ZKUtil(162): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,317 DEBUG [RS:1;jenkins-hbase4:40195] zookeeper.ZKUtil(162): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,317 DEBUG [RS:0;jenkins-hbase4:37705] zookeeper.ZKUtil(162): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,317 DEBUG [RS:0;jenkins-hbase4:37705] zookeeper.ZKUtil(162): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,317 DEBUG [RS:1;jenkins-hbase4:40195] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:48,318 INFO [RS:1;jenkins-hbase4:40195] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:48,318 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 10:01:48,319 INFO [RS:0;jenkins-hbase4:37705] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 10:01:48,319 INFO [RS:1;jenkins-hbase4:40195] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:48,319 INFO [RS:1;jenkins-hbase4:40195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:48,319 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,319 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:48,324 INFO [RS:0;jenkins-hbase4:37705] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 10:01:48,324 INFO [RS:0;jenkins-hbase4:37705] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 10:01:48,324 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,324 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,325 DEBUG [RS:1;jenkins-hbase4:40195] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,326 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,326 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,326 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,326 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,326 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,326 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,326 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,326 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,327 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,327 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-18 10:01:48,327 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,327 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,327 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,327 DEBUG [RS:0;jenkins-hbase4:37705] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-18 10:01:48,328 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,328 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,328 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,337 INFO [RS:1;jenkins-hbase4:40195] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:48,337 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40195,1676714508070-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,340 INFO [RS:0;jenkins-hbase4:37705] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 10:01:48,340 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37705,1676714508047-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,347 INFO [RS:1;jenkins-hbase4:40195] regionserver.Replication(203): jenkins-hbase4.apache.org,40195,1676714508070 started 2023-02-18 10:01:48,347 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40195,1676714508070, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40195, sessionid=0x10066e0e89d0002 2023-02-18 10:01:48,347 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:48,347 DEBUG [RS:1;jenkins-hbase4:40195] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,347 DEBUG [RS:1;jenkins-hbase4:40195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40195,1676714508070' 2023-02-18 10:01:48,347 DEBUG [RS:1;jenkins-hbase4:40195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40195,1676714508070' 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:48,348 DEBUG [RS:1;jenkins-hbase4:40195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:48,349 DEBUG [RS:1;jenkins-hbase4:40195] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:48,349 INFO [RS:1;jenkins-hbase4:40195] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:48,349 INFO [RS:1;jenkins-hbase4:40195] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:48,353 INFO [RS:0;jenkins-hbase4:37705] regionserver.Replication(203): jenkins-hbase4.apache.org,37705,1676714508047 started 2023-02-18 10:01:48,353 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37705,1676714508047, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37705, sessionid=0x10066e0e89d0001 2023-02-18 10:01:48,353 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37705,1676714508047' 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37705,1676714508047' 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:48,354 DEBUG [RS:0;jenkins-hbase4:37705] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 10:01:48,355 INFO [RS:0;jenkins-hbase4:37705] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 10:01:48,355 INFO [RS:0;jenkins-hbase4:37705] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 10:01:48,366 DEBUG [jenkins-hbase4:34329] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 10:01:48,366 DEBUG [jenkins-hbase4:34329] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:48,367 DEBUG [jenkins-hbase4:34329] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:48,367 DEBUG [jenkins-hbase4:34329] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:48,367 DEBUG [jenkins-hbase4:34329] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:48,368 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37705,1676714508047, state=OPENING 2023-02-18 10:01:48,370 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 10:01:48,371 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,371 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:48,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37705,1676714508047}] 2023-02-18 10:01:48,525 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,525 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:48,527 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38198, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:48,531 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 10:01:48,531 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 10:01:48,532 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37705%2C1676714508047.meta, suffix=.meta, logDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,37705,1676714508047, archiveDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/oldWALs, maxLogs=32 2023-02-18 10:01:48,550 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK] 2023-02-18 10:01:48,551 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK] 2023-02-18 10:01:48,552 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,37705,1676714508047/jenkins-hbase4.apache.org%2C37705%2C1676714508047.meta.1676714508533.meta 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK], DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK]] 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 10:01:48,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 10:01:48,553 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 10:01:48,554 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 10:01:48,555 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/info 2023-02-18 10:01:48,555 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/info 2023-02-18 10:01:48,555 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 10:01:48,556 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,556 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 10:01:48,557 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:48,557 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/rep_barrier 2023-02-18 10:01:48,557 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 10:01:48,557 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,557 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 10:01:48,558 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/table 2023-02-18 10:01:48,558 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/table 2023-02-18 10:01:48,558 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 10:01:48,558 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740 2023-02-18 10:01:48,560 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740 2023-02-18 10:01:48,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 10:01:48,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 10:01:48,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65980218, jitterRate=-0.016818135976791382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 10:01:48,563 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 10:01:48,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676714508525 2023-02-18 10:01:48,567 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 10:01:48,568 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 10:01:48,568 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37705,1676714508047, state=OPEN 2023-02-18 10:01:48,570 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 10:01:48,570 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 10:01:48,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 10:01:48,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37705,1676714508047 in 199 msec 2023-02-18 10:01:48,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 10:01:48,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-18 10:01:48,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 384 msec 2023-02-18 10:01:48,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676714508573, completionTime=-1 2023-02-18 10:01:48,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 10:01:48,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 10:01:48,575 DEBUG [hconnection-0x1f23e1f6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:48,577 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38204, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:48,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 10:01:48,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676714568578 2023-02-18 10:01:48,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676714628578 2023-02-18 10:01:48,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-18 10:01:48,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34329,1676714508007-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34329,1676714508007-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34329,1676714508007-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34329, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 10:01:48,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 10:01:48,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:48,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 10:01:48,586 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 10:01:48,586 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:48,587 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:48,588 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/hbase/namespace/626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,588 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/hbase/namespace/626c29900199a26b0e907bfe528882ce empty. 2023-02-18 10:01:48,589 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/hbase/namespace/626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 10:01:48,596 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:48,597 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 626c29900199a26b0e907bfe528882ce, NAME => 'hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp 2023-02-18 10:01:48,602 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:48,602 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 626c29900199a26b0e907bfe528882ce, disabling compactions & flushes 2023-02-18 10:01:48,602 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,602 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,602 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. after waiting 0 ms 2023-02-18 10:01:48,602 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,602 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,602 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 626c29900199a26b0e907bfe528882ce: 2023-02-18 10:01:48,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:48,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714508605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714508605"}]},"ts":"1676714508605"} 2023-02-18 10:01:48,606 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:48,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:48,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714508606"}]},"ts":"1676714508606"} 2023-02-18 10:01:48,607 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 10:01:48,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:48,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:48,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:48,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:48,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=626c29900199a26b0e907bfe528882ce, ASSIGN}] 2023-02-18 10:01:48,612 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=626c29900199a26b0e907bfe528882ce, ASSIGN 2023-02-18 10:01:48,613 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=626c29900199a26b0e907bfe528882ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37705,1676714508047; forceNewPlan=false, retain=false 2023-02-18 10:01:48,763 INFO [jenkins-hbase4:34329] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:48,763 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=626c29900199a26b0e907bfe528882ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,763 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714508763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714508763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714508763"}]},"ts":"1676714508763"} 2023-02-18 10:01:48,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 626c29900199a26b0e907bfe528882ce, server=jenkins-hbase4.apache.org,37705,1676714508047}] 2023-02-18 10:01:48,919 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37705%2C1676714508047, suffix=, logDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,37705,1676714508047, archiveDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/oldWALs, maxLogs=32 2023-02-18 10:01:48,933 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK] 2023-02-18 10:01:48,933 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK] 2023-02-18 10:01:48,934 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,37705,1676714508047/jenkins-hbase4.apache.org%2C37705%2C1676714508047.1676714508920 2023-02-18 10:01:48,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK], DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK]] 2023-02-18 10:01:48,934 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 626c29900199a26b0e907bfe528882ce, NAME => 'hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:48,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:48,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,936 INFO [StoreOpener-626c29900199a26b0e907bfe528882ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,937 DEBUG [StoreOpener-626c29900199a26b0e907bfe528882ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/info 2023-02-18 10:01:48,937 DEBUG [StoreOpener-626c29900199a26b0e907bfe528882ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/info 2023-02-18 10:01:48,937 INFO [StoreOpener-626c29900199a26b0e907bfe528882ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 626c29900199a26b0e907bfe528882ce columnFamilyName info 2023-02-18 10:01:48,937 INFO [StoreOpener-626c29900199a26b0e907bfe528882ce-1] regionserver.HStore(310): Store=626c29900199a26b0e907bfe528882ce/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:48,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:48,941 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:48,942 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 626c29900199a26b0e907bfe528882ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72467442, jitterRate=0.07984903454780579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 10:01:48,942 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 626c29900199a26b0e907bfe528882ce: 2023-02-18 10:01:48,942 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce., pid=6, masterSystemTime=1676714508916 2023-02-18 10:01:48,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,944 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:48,944 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=626c29900199a26b0e907bfe528882ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:48,944 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676714508944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714508944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714508944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714508944"}]},"ts":"1676714508944"} 2023-02-18 10:01:48,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 10:01:48,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 626c29900199a26b0e907bfe528882ce, server=jenkins-hbase4.apache.org,37705,1676714508047 in 180 msec 2023-02-18 10:01:48,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 10:01:48,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=626c29900199a26b0e907bfe528882ce, ASSIGN in 336 msec 2023-02-18 10:01:48,948 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:48,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714508948"}]},"ts":"1676714508948"} 2023-02-18 10:01:48,949 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 10:01:48,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:48,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 366 msec 2023-02-18 10:01:48,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 10:01:48,988 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:48,988 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:48,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 10:01:49,001 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:49,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-18 10:01:49,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 10:01:49,011 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 10:01:49,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-18 10:01:49,028 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 10:01:49,031 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 10:01:49,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.943sec 2023-02-18 10:01:49,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 10:01:49,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 10:01:49,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 10:01:49,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34329,1676714508007-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 10:01:49,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34329,1676714508007-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 10:01:49,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 10:01:49,082 DEBUG [Listener at localhost/39743] zookeeper.ReadOnlyZKClient(139): Connect 0x527b2d0f to 127.0.0.1:49179 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:49,084 DEBUG [Listener at localhost/39743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4490f908, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:49,086 DEBUG [hconnection-0x33d3d800-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:49,088 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38208, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:49,089 INFO [Listener at localhost/39743] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:49,089 DEBUG [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 10:01:49,091 DEBUG [Listener at localhost/39743] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 10:01:49,092 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 10:01:49,093 INFO [Listener at localhost/39743] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 10:01:49,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 10:01:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 10:01:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:38870 deadline: 1676714569093, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 10:01:49,094 INFO [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 10:01:49,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 10:01:49,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 10:01:49,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 10:01:49,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 10:01:49,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 10:01:49,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:49,099 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,100 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 empty. 2023-02-18 10:01:49,100 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,100 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 10:01:49,109 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 10:01:49,109 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ddcec6dcabd1ff85fed40ce6ad62e244, NAME => 'testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp 2023-02-18 10:01:49,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:49,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ddcec6dcabd1ff85fed40ce6ad62e244, disabling compactions & flushes 2023-02-18 10:01:49,115 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. after waiting 0 ms 2023-02-18 10:01:49,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,115 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:49,117 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 10:01:49,118 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676714509118"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714509118"}]},"ts":"1676714509118"} 2023-02-18 10:01:49,119 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 10:01:49,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 10:01:49,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714509120"}]},"ts":"1676714509120"} 2023-02-18 10:01:49,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 10:01:49,127 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-18 10:01:49,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 10:01:49,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 10:01:49,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 10:01:49,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, ASSIGN}] 2023-02-18 10:01:49,129 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, ASSIGN 2023-02-18 10:01:49,130 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40195,1676714508070; forceNewPlan=false, retain=false 2023-02-18 10:01:49,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:49,280 INFO [jenkins-hbase4:34329] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 10:01:49,280 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ddcec6dcabd1ff85fed40ce6ad62e244, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,280 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676714509280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714509280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714509280"}]},"ts":"1676714509280"} 2023-02-18 10:01:49,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ddcec6dcabd1ff85fed40ce6ad62e244, server=jenkins-hbase4.apache.org,40195,1676714508070}] 2023-02-18 10:01:49,350 INFO [RS:1;jenkins-hbase4:40195] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40195%2C1676714508070, suffix=, logDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,40195,1676714508070, archiveDir=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/oldWALs, maxLogs=32 2023-02-18 10:01:49,367 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK] 2023-02-18 10:01:49,367 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK] 2023-02-18 10:01:49,369 INFO [RS:1;jenkins-hbase4:40195] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/WALs/jenkins-hbase4.apache.org,40195,1676714508070/jenkins-hbase4.apache.org%2C40195%2C1676714508070.1676714509351 2023-02-18 10:01:49,369 DEBUG [RS:1;jenkins-hbase4:40195] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33379,DS-ef15cd16-2d45-44bc-8349-9b2cda35f640,DISK], DatanodeInfoWithStorage[127.0.0.1:40685,DS-865e3675-831c-44d8-b0c4-48b407d31eec,DISK]] 2023-02-18 10:01:49,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:49,434 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,435 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 10:01:49,436 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37920, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 10:01:49,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ddcec6dcabd1ff85fed40ce6ad62e244, NAME => 'testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.', STARTKEY => '', ENDKEY => ''} 2023-02-18 10:01:49,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:49,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,440 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,441 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1 2023-02-18 10:01:49,441 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1 2023-02-18 10:01:49,442 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddcec6dcabd1ff85fed40ce6ad62e244 columnFamilyName f1 2023-02-18 10:01:49,442 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(310): Store=ddcec6dcabd1ff85fed40ce6ad62e244/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:49,442 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,443 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2 2023-02-18 10:01:49,443 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2 2023-02-18 10:01:49,443 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddcec6dcabd1ff85fed40ce6ad62e244 columnFamilyName f2 2023-02-18 10:01:49,444 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(310): Store=ddcec6dcabd1ff85fed40ce6ad62e244/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:49,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:49,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:49,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 10:01:49,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ddcec6dcabd1ff85fed40ce6ad62e244; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64897615, jitterRate=-0.032950177788734436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:49,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:49,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244., pid=12, masterSystemTime=1676714509434 2023-02-18 10:01:49,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,454 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ddcec6dcabd1ff85fed40ce6ad62e244, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,454 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676714509454"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676714509454"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676714509454"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676714509454"}]},"ts":"1676714509454"} 2023-02-18 10:01:49,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 10:01:49,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ddcec6dcabd1ff85fed40ce6ad62e244, server=jenkins-hbase4.apache.org,40195,1676714508070 in 173 msec 2023-02-18 10:01:49,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 10:01:49,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, ASSIGN in 329 msec 2023-02-18 10:01:49,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 10:01:49,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714509459"}]},"ts":"1676714509459"} 2023-02-18 10:01:49,460 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 10:01:49,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 10:01:49,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 367 msec 2023-02-18 10:01:49,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 10:01:49,703 INFO [Listener at localhost/39743] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 10:01:49,703 DEBUG [Listener at localhost/39743] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 10:01:49,703 INFO [Listener at localhost/39743] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:49,705 INFO [Listener at localhost/39743] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 10:01:49,705 INFO [Listener at localhost/39743] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 10:01:49,705 INFO [Listener at localhost/39743] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 10:01:49,705 INFO [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 10:01:49,717 DEBUG [hconnection-0x33d3d800-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:49,728 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37922, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:49,736 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40195] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,822 INFO [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 10:01:49,822 INFO [Listener at localhost/39743] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 10:01:49,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:49,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676714509823 (current time:1676714509823). 2023-02-18 10:01:49,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 10:01:49,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] zookeeper.ReadOnlyZKClient(139): Connect 0x1a9972f8 to 127.0.0.1:49179 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 10:01:49,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2634e547, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 10:01:49,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 10:01:49,829 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 10:01:49,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a9972f8 to 127.0.0.1:49179 2023-02-18 10:01:49,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:49,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 10:01:49,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:49,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:49,833 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:49,833 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676715109833 2023-02-18 10:01:49,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 10:01:49,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 10:01:49,835 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:49,835 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 10:01:49,835 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 10:01:49,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:49,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-18 10:01:49,836 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:49,837 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676715109837 2023-02-18 10:01:49,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-18 10:01:49,844 INFO [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-18 10:01:49,844 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:49,845 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-18 10:01:49,845 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 10:01:49,845 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,845 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,846 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:49,846 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:49,846 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:49,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:49,846 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,847 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-18 10:01:49,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-18 10:01:49,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-18 10:01:49,848 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-18 10:01:49,848 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:49,848 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-18 10:01:49,849 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 10:01:49,849 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 10:01:49,851 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 10:01:49,851 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-18 10:01:49,851 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40195,1676714508070' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-18 10:01:49,851 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-18 10:01:49,851 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37705,1676714508047' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-18 10:01:49,853 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,853 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,853 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:49,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:49,853 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,853 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:49,853 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,853 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:49,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:49,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:49,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 10:01:49,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:49,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40195,1676714508070' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-18 10:01:49,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73ed2d94[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:49,855 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 10:01:49,855 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,856 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 10:01:49,856 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 10:01:49,856 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,856 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:49,856 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-18 10:01:49,856 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37705,1676714508047' in zk 2023-02-18 10:01:49,856 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 10:01:49,856 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 10:01:49,856 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,856 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. started... 2023-02-18 10:01:49,856 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ddcec6dcabd1ff85fed40ce6ad62e244 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 10:01:49,857 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-18 10:01:49,857 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:49,857 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-18 10:01:49,871 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f1/6c03fbd11882488088b9f39fc1cb0e61 2023-02-18 10:01:49,889 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f2/44a6f6031fe7473eb049a14f88c5b55c 2023-02-18 10:01:49,892 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f1/6c03fbd11882488088b9f39fc1cb0e61 as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/6c03fbd11882488088b9f39fc1cb0e61 2023-02-18 10:01:49,895 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/6c03fbd11882488088b9f39fc1cb0e61, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:49,896 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f2/44a6f6031fe7473eb049a14f88c5b55c as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/44a6f6031fe7473eb049a14f88c5b55c 2023-02-18 10:01:49,899 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/44a6f6031fe7473eb049a14f88c5b55c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 10:01:49,899 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ddcec6dcabd1ff85fed40ce6ad62e244 in 43ms, sequenceid=5, compaction requested=false 2023-02-18 10:01:49,899 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:49,899 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-18 10:01:49,899 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 10:01:49,900 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/6c03fbd11882488088b9f39fc1cb0e61] hfiles 2023-02-18 10:01:49,900 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/6c03fbd11882488088b9f39fc1cb0e61 for snapshot=testWithMapReduceSingleRegion 2023-02-18 10:01:49,900 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/44a6f6031fe7473eb049a14f88c5b55c] hfiles 2023-02-18 10:01:49,900 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/44a6f6031fe7473eb049a14f88c5b55c for snapshot=testWithMapReduceSingleRegion 2023-02-18 10:01:49,907 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. completed. 2023-02-18 10:01:49,907 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:49,907 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 10:01:49,907 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 10:01:49,907 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,907 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-18 10:01:49,907 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40195,1676714508070' in zk 2023-02-18 10:01:49,908 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-18 10:01:49,908 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,908 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:49,908 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-18 10:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 10:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 10:01:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40195,1676714508070': 2023-02-18 10:01:49,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40195,1676714508070' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 10:01:49,911 INFO [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-18 10:01:49,911 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:49,911 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:49,911 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-18 10:01:49,911 INFO [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 10:01:49,914 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:49,914 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:49,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:49,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:49,914 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 10:01:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,915 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 10:01:49,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:49,916 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 10:01:49,916 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:49,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:49,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 10:01:49,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:49,922 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 10:01:49,922 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:49,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 10:01:49,923 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 10:01:49,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:49,923 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:49,923 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 10:01:49,923 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 10:01:49,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 10:01:49,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 10:01:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 10:01:49,935 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 10:01:49,936 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 10:01:49,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-18 10:01:49,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-18 10:01:49,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 10:01:49,951 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 10:01:49,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676714509834Consolidate snapshot: testWithMapReduceSingleRegion at 1676714509922 (+88 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676714509922Writing data manifest for testWithMapReduceSingleRegion at 1676714509925 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676714509932 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676714509951 (+19 ms) 2023-02-18 10:01:49,953 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 10:01:49,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 119 msec 2023-02-18 10:01:50,136 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 10:01:50,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 10:01:50,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 10:01:50,138 INFO [Listener at localhost/39743] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 10:01:50,142 INFO [Listener at localhost/39743] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 10:01:50,148 INFO [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 10:01:50,175 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40195] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,254 INFO [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 10:01:50,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-18 10:01:50,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 10:01:50,261 INFO [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 10:01:50,261 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:50,261 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 10:01:50,261 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 10:01:50,261 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,261 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,263 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:50,263 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:50,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:50,263 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,263 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,263 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 10:01:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 10:01:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 10:01:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 10:01:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 10:01:50,264 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 10:01:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 10:01:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 10:01:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37705,1676714508047' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 10:01:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 10:01:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 10:01:50,265 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,265 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. started... 2023-02-18 10:01:50,265 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ddcec6dcabd1ff85fed40ce6ad62e244 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 10:01:50,267 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,268 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,268 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:50,281 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f1/c388db241ada451ca2ef28f456276536 2023-02-18 10:01:50,304 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f2/32ba9d8459cc409f946971e19bf61f71 2023-02-18 10:01:50,308 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f1/c388db241ada451ca2ef28f456276536 as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/c388db241ada451ca2ef28f456276536 2023-02-18 10:01:50,311 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/c388db241ada451ca2ef28f456276536, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:50,312 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/.tmp/f2/32ba9d8459cc409f946971e19bf61f71 as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/32ba9d8459cc409f946971e19bf61f71 2023-02-18 10:01:50,315 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/32ba9d8459cc409f946971e19bf61f71, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 10:01:50,315 INFO [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ddcec6dcabd1ff85fed40ce6ad62e244 in 50ms, sequenceid=9, compaction requested=false 2023-02-18 10:01:50,315 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:50,315 DEBUG [rs(jenkins-hbase4.apache.org,40195,1676714508070)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 10:01:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 10:01:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 10:01:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40195,1676714508070' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 10:01:50,317 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,317 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:50,318 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,318 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 10:01:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:50,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40195,1676714508070' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 10:01:50,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77d2a731[Count = 0] remaining members to acquire global barrier 2023-02-18 10:01:50,319 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 10:01:50,319 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,320 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,320 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 10:01:50,320 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 10:01:50,320 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 10:01:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40195,1676714508070' in zk 2023-02-18 10:01:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 10:01:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 10:01:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37705,1676714508047' in zk 2023-02-18 10:01:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 10:01:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 10:01:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:50,322 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,40195,1676714508070' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 10:01:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,37705,1676714508047' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 10:01:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40195,1676714508070': 2023-02-18 10:01:50,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40195,1676714508070' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 10:01:50,325 INFO [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 10:01:50,325 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 10:01:50,325 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 10:01:50,325 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 10:01:50,325 INFO [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 10:01:50,327 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,327 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:50,328 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:50,327 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 10:01:50,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:50,328 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 10:01:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,329 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,330 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 10:01:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 10:01:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 10:01:50,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:50,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 10:01:50,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 10:01:50,332 DEBUG [(jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 10:01:50,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 10:01:50,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 10:01:50,332 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 10:01:50,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 10:01:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 10:01:50,333 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 10:01:50,433 DEBUG [Listener at localhost/39743] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 10:01:50,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 10:01:50,536 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/hadoop-6798112439326984922.jar 2023-02-18 10:01:50,539 INFO [Listener at localhost/39743] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676714509823 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:50,540 DEBUG [Listener at localhost/39743] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91/data/default/testWithMapReduce 2023-02-18 10:01:50,540 INFO [Listener at localhost/39743] snapshot.RestoreSnapshotHelper(239): region to add: ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:50,540 INFO [Listener at localhost/39743] snapshot.RestoreSnapshotHelper(585): clone region=ddcec6dcabd1ff85fed40ce6ad62e244 as ddcec6dcabd1ff85fed40ce6ad62e244 in snapshot testWithMapReduceSingleRegion 2023-02-18 10:01:50,541 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ddcec6dcabd1ff85fed40ce6ad62e244, NAME => 'testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91 2023-02-18 10:01:50,550 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:50,550 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6c03fbd11882488088b9f39fc1cb0e61 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-18 10:01:50,552 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 44a6f6031fe7473eb049a14f88c5b55c from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-18 10:01:50,554 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ddcec6dcabd1ff85fed40ce6ad62e244, disabling compactions & flushes 2023-02-18 10:01:50,554 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,554 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,554 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. after waiting 0 ms 2023-02-18 10:01:50,554 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,554 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:50,554 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:50,554 INFO [Listener at localhost/39743] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676714509823 type: FLUSH version: 2 ttl: 0 2023-02-18 10:01:50,554 DEBUG [Listener at localhost/39743] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91 2023-02-18 10:01:50,555 DEBUG [Listener at localhost/39743] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91 2023-02-18 10:01:50,555 DEBUG [Listener at localhost/39743] util.CommonFSUtils(699): |-data/ 2023-02-18 10:01:50,555 DEBUG [Listener at localhost/39743] util.CommonFSUtils(699): |----default/ 2023-02-18 10:01:50,556 DEBUG [Listener at localhost/39743] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 10:01:50,556 DEBUG [Listener at localhost/39743] util.CommonFSUtils(699): |----------ddcec6dcabd1ff85fed40ce6ad62e244/ 2023-02-18 10:01:50,557 DEBUG [Listener at localhost/39743] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 10:01:50,557 DEBUG [Listener at localhost/39743] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 10:01:50,557 DEBUG [Listener at localhost/39743] util.CommonFSUtils(702): |----------------testWithMapReduce=ddcec6dcabd1ff85fed40ce6ad62e244-6c03fbd11882488088b9f39fc1cb0e61 2023-02-18 10:01:50,557 DEBUG [Listener at localhost/39743] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 10:01:50,557 DEBUG [Listener at localhost/39743] util.CommonFSUtils(702): |----------------testWithMapReduce=ddcec6dcabd1ff85fed40ce6ad62e244-44a6f6031fe7473eb049a14f88c5b55c 2023-02-18 10:01:50,558 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,559 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,559 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,560 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,560 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,561 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,561 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,630 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/hadoop-7291610384237515123.jar 2023-02-18 10:01:50,630 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,631 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,631 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,631 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,631 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,632 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,632 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 10:01:50,632 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 10:01:50,633 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 10:01:50,633 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 10:01:50,633 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 10:01:50,634 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 10:01:50,634 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 10:01:50,634 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 10:01:50,635 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 10:01:50,635 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 10:01:50,636 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 10:01:50,636 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:50,636 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:50,636 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 10:01:50,637 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 10:01:50,716 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/hadoop-7441563781091521722.jar 2023-02-18 10:01:50,717 DEBUG [Listener at localhost/39743] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 10:01:50,724 WARN [Listener at localhost/39743] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 10:01:50,761 INFO [Listener at localhost/39743] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 10:01:50,847 WARN [Listener at localhost/39743] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/mapreduce.cluster.local.dir/1676714510807/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 10:01:50,847 WARN [Listener at localhost/39743] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/mapreduce.cluster.local.dir/1676714510807/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 10:01:50,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 10:01:50,882 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 10:01:50,882 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 10:01:50,884 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:50,885 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1 2023-02-18 10:01:50,885 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddcec6dcabd1ff85fed40ce6ad62e244 columnFamilyName f1 2023-02-18 10:01:50,889 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(539): loaded hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/testWithMapReduce=ddcec6dcabd1ff85fed40ce6ad62e244-6c03fbd11882488088b9f39fc1cb0e61 2023-02-18 10:01:50,889 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(310): Store=ddcec6dcabd1ff85fed40ce6ad62e244/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:50,889 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:50,890 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2 2023-02-18 10:01:50,890 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ddcec6dcabd1ff85fed40ce6ad62e244 columnFamilyName f2 2023-02-18 10:01:50,894 DEBUG [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(539): loaded hdfs://localhost:40077/user/jenkins/test-data/90e37ea6-3519-ca3b-0368-5cad00d9caac/testWithMapReduceSingleRegion/63492f1c-e5e7-454c-85a0-36bd2ecceb91/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/testWithMapReduce=ddcec6dcabd1ff85fed40ce6ad62e244-44a6f6031fe7473eb049a14f88c5b55c 2023-02-18 10:01:50,894 INFO [StoreOpener-ddcec6dcabd1ff85fed40ce6ad62e244-1] regionserver.HStore(310): Store=ddcec6dcabd1ff85fed40ce6ad62e244/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 10:01:50,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 10:01:50,894 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ddcec6dcabd1ff85fed40ce6ad62e244; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67393067, jitterRate=0.0042349547147750854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 10:01:50,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:51,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ddcec6dcabd1ff85fed40ce6ad62e244, disabling compactions & flushes 2023-02-18 10:01:51,025 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:51,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:51,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. after waiting 0 ms 2023-02-18 10:01:51,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:51,026 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:51,026 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:51,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-18 10:01:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-18 10:01:51,889 INFO [Listener at localhost/39743] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 10:01:51,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-18 10:01:51,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-18 10:01:51,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:51,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714511892"}]},"ts":"1676714511892"} 2023-02-18 10:01:51,893 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-18 10:01:51,895 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-18 10:01:51,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, UNASSIGN}] 2023-02-18 10:01:51,896 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, UNASSIGN 2023-02-18 10:01:51,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ddcec6dcabd1ff85fed40ce6ad62e244, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:51,897 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676714511897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676714511897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676714511897"}]},"ts":"1676714511897"} 2023-02-18 10:01:51,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ddcec6dcabd1ff85fed40ce6ad62e244, server=jenkins-hbase4.apache.org,40195,1676714508070}] 2023-02-18 10:01:51,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:52,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:52,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ddcec6dcabd1ff85fed40ce6ad62e244, disabling compactions & flushes 2023-02-18 10:01:52,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:52,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:52,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. after waiting 0 ms 2023-02-18 10:01:52,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:52,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 10:01:52,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244. 2023-02-18 10:01:52,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ddcec6dcabd1ff85fed40ce6ad62e244: 2023-02-18 10:01:52,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:52,056 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ddcec6dcabd1ff85fed40ce6ad62e244, regionState=CLOSED 2023-02-18 10:01:52,056 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676714512056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676714512056"}]},"ts":"1676714512056"} 2023-02-18 10:01:52,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 10:01:52,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ddcec6dcabd1ff85fed40ce6ad62e244, server=jenkins-hbase4.apache.org,40195,1676714508070 in 159 msec 2023-02-18 10:01:52,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 10:01:52,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ddcec6dcabd1ff85fed40ce6ad62e244, UNASSIGN in 162 msec 2023-02-18 10:01:52,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676714512060"}]},"ts":"1676714512060"} 2023-02-18 10:01:52,061 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-18 10:01:52,062 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-18 10:01:52,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 174 msec 2023-02-18 10:01:52,104 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 10:01:52,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 10:01:52,195 INFO [Listener at localhost/39743] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-18 10:01:52,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-18 10:01:52,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:52,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:52,201 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:52,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:52,203 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:52,208 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1, FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2, FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/recovered.edits] 2023-02-18 10:01:52,211 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/6c03fbd11882488088b9f39fc1cb0e61 to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/archive/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/6c03fbd11882488088b9f39fc1cb0e61 2023-02-18 10:01:52,212 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/c388db241ada451ca2ef28f456276536 to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/archive/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f1/c388db241ada451ca2ef28f456276536 2023-02-18 10:01:52,219 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/32ba9d8459cc409f946971e19bf61f71 to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/archive/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/32ba9d8459cc409f946971e19bf61f71 2023-02-18 10:01:52,221 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/44a6f6031fe7473eb049a14f88c5b55c to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/archive/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/f2/44a6f6031fe7473eb049a14f88c5b55c 2023-02-18 10:01:52,223 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/recovered.edits/12.seqid to hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/archive/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244/recovered.edits/12.seqid 2023-02-18 10:01:52,223 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/.tmp/data/default/testWithMapReduce/ddcec6dcabd1ff85fed40ce6ad62e244 2023-02-18 10:01:52,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 10:01:52,225 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:52,227 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-18 10:01:52,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-18 10:01:52,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:52,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-18 10:01:52,229 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676714512229"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:52,231 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 10:01:52,231 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ddcec6dcabd1ff85fed40ce6ad62e244, NAME => 'testWithMapReduce,,1676714509095.ddcec6dcabd1ff85fed40ce6ad62e244.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 10:01:52,231 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-18 10:01:52,231 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676714512231"}]},"ts":"9223372036854775807"} 2023-02-18 10:01:52,232 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-18 10:01:52,234 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 10:01:52,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 38 msec 2023-02-18 10:01:52,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34329] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 10:01:52,303 INFO [Listener at localhost/39743] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-18 10:01:52,303 INFO [Listener at localhost/39743] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 10:01:52,303 INFO [Listener at localhost/39743] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 10:01:52,303 DEBUG [Listener at localhost/39743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x527b2d0f to 127.0.0.1:49179 2023-02-18 10:01:52,303 DEBUG [Listener at localhost/39743] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,303 DEBUG [Listener at localhost/39743] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 10:01:52,304 DEBUG [Listener at localhost/39743] util.JVMClusterUtil(257): Found active master hash=1103886710, stopped=false 2023-02-18 10:01:52,304 INFO [Listener at localhost/39743] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:52,305 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:52,305 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:52,305 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:52,305 INFO [Listener at localhost/39743] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 10:01:52,305 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 10:01:52,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:52,307 DEBUG [Listener at localhost/39743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x195ccb8d to 127.0.0.1:49179 2023-02-18 10:01:52,308 DEBUG [Listener at localhost/39743] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,308 INFO [Listener at localhost/39743] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37705,1676714508047' ***** 2023-02-18 10:01:52,308 INFO [Listener at localhost/39743] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:52,308 INFO [Listener at localhost/39743] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40195,1676714508070' ***** 2023-02-18 10:01:52,308 INFO [Listener at localhost/39743] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 10:01:52,308 INFO [RS:1;jenkins-hbase4:40195] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:52,308 INFO [RS:1;jenkins-hbase4:40195] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:52,308 INFO [RS:1;jenkins-hbase4:40195] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:52,308 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:52,308 INFO [RS:0;jenkins-hbase4:37705] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 10:01:52,309 INFO [RS:0;jenkins-hbase4:37705] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 10:01:52,309 INFO [RS:0;jenkins-hbase4:37705] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 10:01:52,309 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(3304): Received CLOSE for 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:52,309 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:52,308 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 10:01:52,308 DEBUG [RS:1;jenkins-hbase4:40195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a47cfff to 127.0.0.1:49179 2023-02-18 10:01:52,309 DEBUG [RS:1;jenkins-hbase4:40195] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,309 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40195,1676714508070; all regions closed. 2023-02-18 10:01:52,309 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:52,309 DEBUG [RS:0;jenkins-hbase4:37705] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f1df2e1 to 127.0.0.1:49179 2023-02-18 10:01:52,310 DEBUG [RS:0;jenkins-hbase4:37705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,310 INFO [RS:0;jenkins-hbase4:37705] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:52,310 INFO [RS:0;jenkins-hbase4:37705] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:52,310 INFO [RS:0;jenkins-hbase4:37705] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:52,310 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 10:01:52,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 626c29900199a26b0e907bfe528882ce, disabling compactions & flushes 2023-02-18 10:01:52,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:52,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:52,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. after waiting 0 ms 2023-02-18 10:01:52,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:52,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 626c29900199a26b0e907bfe528882ce 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 10:01:52,312 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 10:01:52,312 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 626c29900199a26b0e907bfe528882ce=hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce.} 2023-02-18 10:01:52,312 DEBUG [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1505): Waiting on 1588230740, 626c29900199a26b0e907bfe528882ce 2023-02-18 10:01:52,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 10:01:52,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 10:01:52,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 10:01:52,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 10:01:52,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 10:01:52,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-18 10:01:52,321 DEBUG [RS:1;jenkins-hbase4:40195] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/oldWALs 2023-02-18 10:01:52,321 INFO [RS:1;jenkins-hbase4:40195] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40195%2C1676714508070:(num 1676714509351) 2023-02-18 10:01:52,321 DEBUG [RS:1;jenkins-hbase4:40195] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,321 INFO [RS:1;jenkins-hbase4:40195] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:52,321 INFO [RS:1;jenkins-hbase4:40195] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:52,321 INFO [RS:1;jenkins-hbase4:40195] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 10:01:52,321 INFO [RS:1;jenkins-hbase4:40195] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 10:01:52,322 INFO [RS:1;jenkins-hbase4:40195] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 10:01:52,322 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:52,323 INFO [RS:1;jenkins-hbase4:40195] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40195 2023-02-18 10:01:52,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/.tmp/info/cf7778c1080f4e3da91cce40ca8c1eef 2023-02-18 10:01:52,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/.tmp/info/cf7778c1080f4e3da91cce40ca8c1eef as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/info/cf7778c1080f4e3da91cce40ca8c1eef 2023-02-18 10:01:52,342 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:52,343 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:52,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/.tmp/info/02555de520f94abcb9ac9fcf8c214c8e 2023-02-18 10:01:52,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/info/cf7778c1080f4e3da91cce40ca8c1eef, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 10:01:52,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02555de520f94abcb9ac9fcf8c214c8e 2023-02-18 10:01:52,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 626c29900199a26b0e907bfe528882ce in 41ms, sequenceid=6, compaction requested=false 2023-02-18 10:01:52,367 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 10:01:52,367 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 10:01:52,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/namespace/626c29900199a26b0e907bfe528882ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 10:01:52,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:52,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 626c29900199a26b0e907bfe528882ce: 2023-02-18 10:01:52,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676714508584.626c29900199a26b0e907bfe528882ce. 2023-02-18 10:01:52,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/.tmp/rep_barrier/28f6ec3b89564a3ab99bc31eef7f5c49 2023-02-18 10:01:52,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28f6ec3b89564a3ab99bc31eef7f5c49 2023-02-18 10:01:52,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/.tmp/table/c7ea2f6494e5480581538931b8af260d 2023-02-18 10:01:52,408 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:52,408 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40195,1676714508070 2023-02-18 10:01:52,408 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:52,408 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:52,408 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:52,408 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32375241 rejected from java.util.concurrent.ThreadPoolExecutor@3608c0df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:52,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 10:01:52,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7ea2f6494e5480581538931b8af260d 2023-02-18 10:01:52,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/.tmp/info/02555de520f94abcb9ac9fcf8c214c8e as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/info/02555de520f94abcb9ac9fcf8c214c8e 2023-02-18 10:01:52,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02555de520f94abcb9ac9fcf8c214c8e 2023-02-18 10:01:52,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/info/02555de520f94abcb9ac9fcf8c214c8e, entries=12, sequenceid=21, filesize=6.2 K 2023-02-18 10:01:52,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/.tmp/rep_barrier/28f6ec3b89564a3ab99bc31eef7f5c49 as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/rep_barrier/28f6ec3b89564a3ab99bc31eef7f5c49 2023-02-18 10:01:52,421 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28f6ec3b89564a3ab99bc31eef7f5c49 2023-02-18 10:01:52,421 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/rep_barrier/28f6ec3b89564a3ab99bc31eef7f5c49, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 10:01:52,422 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/.tmp/table/c7ea2f6494e5480581538931b8af260d as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/table/c7ea2f6494e5480581538931b8af260d 2023-02-18 10:01:52,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7ea2f6494e5480581538931b8af260d 2023-02-18 10:01:52,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/table/c7ea2f6494e5480581538931b8af260d, entries=4, sequenceid=21, filesize=5.0 K 2023-02-18 10:01:52,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 116ms, sequenceid=21, compaction requested=false 2023-02-18 10:01:52,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 10:01:52,440 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 10:01:52,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:52,442 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 10:01:52,442 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 10:01:52,510 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40195,1676714508070] 2023-02-18 10:01:52,510 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40195,1676714508070; numProcessing=1 2023-02-18 10:01:52,511 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40195,1676714508070 already deleted, retry=false 2023-02-18 10:01:52,511 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40195,1676714508070 expired; onlineServers=1 2023-02-18 10:01:52,512 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37705,1676714508047; all regions closed. 2023-02-18 10:01:52,518 DEBUG [RS:0;jenkins-hbase4:37705] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/oldWALs 2023-02-18 10:01:52,518 INFO [RS:0;jenkins-hbase4:37705] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37705%2C1676714508047.meta:.meta(num 1676714508533) 2023-02-18 10:01:52,521 DEBUG [RS:0;jenkins-hbase4:37705] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/oldWALs 2023-02-18 10:01:52,521 INFO [RS:0;jenkins-hbase4:37705] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37705%2C1676714508047:(num 1676714508920) 2023-02-18 10:01:52,521 DEBUG [RS:0;jenkins-hbase4:37705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,522 INFO [RS:0;jenkins-hbase4:37705] regionserver.LeaseManager(133): Closed leases 2023-02-18 10:01:52,522 INFO [RS:0;jenkins-hbase4:37705] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 10:01:52,522 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:52,524 INFO [RS:0;jenkins-hbase4:37705] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37705 2023-02-18 10:01:52,527 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37705,1676714508047 2023-02-18 10:01:52,527 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 10:01:52,527 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f6a0572 rejected from java.util.concurrent.ThreadPoolExecutor@b559047[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,528 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37705,1676714508047] 2023-02-18 10:01:52,528 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37705,1676714508047; numProcessing=2 2023-02-18 10:01:52,529 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37705,1676714508047 already deleted, retry=false 2023-02-18 10:01:52,529 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37705,1676714508047 expired; onlineServers=0 2023-02-18 10:01:52,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34329,1676714508007' ***** 2023-02-18 10:01:52,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 10:01:52,530 DEBUG [M:0;jenkins-hbase4:34329] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45f47597, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-18 10:01:52,530 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34329,1676714508007 2023-02-18 10:01:52,530 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34329,1676714508007; all regions closed. 2023-02-18 10:01:52,530 DEBUG [M:0;jenkins-hbase4:34329] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 10:01:52,530 DEBUG [M:0;jenkins-hbase4:34329] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 10:01:52,530 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 10:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714508193] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676714508193,5,FailOnTimeoutGroup] 2023-02-18 10:01:52,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714508193] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676714508193,5,FailOnTimeoutGroup] 2023-02-18 10:01:52,530 DEBUG [M:0;jenkins-hbase4:34329] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 10:01:52,531 INFO [M:0;jenkins-hbase4:34329] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 10:01:52,531 INFO [M:0;jenkins-hbase4:34329] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 10:01:52,531 INFO [M:0;jenkins-hbase4:34329] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-18 10:01:52,531 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 10:01:52,531 DEBUG [M:0;jenkins-hbase4:34329] master.HMaster(1512): Stopping service threads 2023-02-18 10:01:52,531 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 10:01:52,532 INFO [M:0;jenkins-hbase4:34329] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 10:01:52,532 ERROR [M:0;jenkins-hbase4:34329] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 10:01:52,532 INFO [M:0;jenkins-hbase4:34329] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 10:01:52,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 10:01:52,532 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 10:01:52,533 DEBUG [M:0;jenkins-hbase4:34329] zookeeper.ZKUtil(398): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 10:01:52,533 WARN [M:0;jenkins-hbase4:34329] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 10:01:52,533 INFO [M:0;jenkins-hbase4:34329] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 10:01:52,533 INFO [M:0;jenkins-hbase4:34329] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 10:01:52,533 DEBUG [M:0;jenkins-hbase4:34329] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 10:01:52,533 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:52,533 DEBUG [M:0;jenkins-hbase4:34329] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:52,533 DEBUG [M:0;jenkins-hbase4:34329] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 10:01:52,533 DEBUG [M:0;jenkins-hbase4:34329] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:52,533 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.70 KB heapSize=65.67 KB 2023-02-18 10:01:52,541 INFO [M:0;jenkins-hbase4:34329] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.70 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a0911bd995b46b588356eac0a53ef3b 2023-02-18 10:01:52,545 DEBUG [M:0;jenkins-hbase4:34329] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8a0911bd995b46b588356eac0a53ef3b as hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a0911bd995b46b588356eac0a53ef3b 2023-02-18 10:01:52,548 INFO [M:0;jenkins-hbase4:34329] regionserver.HStore(1080): Added hdfs://localhost:40077/user/jenkins/test-data/9c0c0067-2bcc-4acb-c94f-ba6c77213270/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8a0911bd995b46b588356eac0a53ef3b, entries=17, sequenceid=132, filesize=8.6 K 2023-02-18 10:01:52,549 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegion(2947): Finished flush of dataSize ~54.70 KB/56017, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-18 10:01:52,549 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 10:01:52,549 DEBUG [M:0;jenkins-hbase4:34329] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 10:01:52,551 INFO [M:0;jenkins-hbase4:34329] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 10:01:52,551 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 10:01:52,551 INFO [M:0;jenkins-hbase4:34329] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34329 2023-02-18 10:01:52,553 DEBUG [M:0;jenkins-hbase4:34329] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34329,1676714508007 already deleted, retry=false 2023-02-18 10:01:52,709 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:52,709 INFO [RS:1;jenkins-hbase4:40195] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40195,1676714508070; zookeeper connection closed. 2023-02-18 10:01:52,709 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a1e3867 rejected from java.util.concurrent.ThreadPoolExecutor@3608c0df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,710 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:40195-0x10066e0e89d0002, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:52,710 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f58ca5c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f58ca5c 2023-02-18 10:01:52,710 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@324df08e rejected from java.util.concurrent.ThreadPoolExecutor@3608c0df[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,810 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:52,810 INFO [M:0;jenkins-hbase4:34329] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34329,1676714508007; zookeeper connection closed. 2023-02-18 10:01:52,810 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cc5c8ff rejected from java.util.concurrent.ThreadPoolExecutor@18fa5fbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,811 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): master:34329-0x10066e0e89d0000, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:52,811 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e5f31f8 rejected from java.util.concurrent.ThreadPoolExecutor@18fa5fbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,910 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:52,910 INFO [RS:0;jenkins-hbase4:37705] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37705,1676714508047; zookeeper connection closed. 2023-02-18 10:01:52,910 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@204d21f7 rejected from java.util.concurrent.ThreadPoolExecutor@b559047[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,910 DEBUG [Listener at localhost/39743-EventThread] zookeeper.ZKWatcher(600): regionserver:37705-0x10066e0e89d0001, quorum=127.0.0.1:49179, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 10:01:52,910 ERROR [Listener at localhost/39743-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5823910c rejected from java.util.concurrent.ThreadPoolExecutor@b559047[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 10:01:52,910 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d15095f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d15095f 2023-02-18 10:01:52,910 INFO [Listener at localhost/39743] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 10:01:52,910 WARN [Listener at localhost/39743] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:52,914 INFO [Listener at localhost/39743] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:53,015 WARN [BP-1207415590-172.31.14.131-1676714507388 heartbeating to localhost/127.0.0.1:40077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:53,015 WARN [BP-1207415590-172.31.14.131-1676714507388 heartbeating to localhost/127.0.0.1:40077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1207415590-172.31.14.131-1676714507388 (Datanode Uuid f2445601-1dc2-4e98-bc70-4fb0e1bf3022) service to localhost/127.0.0.1:40077 2023-02-18 10:01:53,016 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/dfs/data/data3/current/BP-1207415590-172.31.14.131-1676714507388] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:53,016 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/dfs/data/data4/current/BP-1207415590-172.31.14.131-1676714507388] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:53,018 WARN [Listener at localhost/39743] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 10:01:53,021 INFO [Listener at localhost/39743] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:53,122 WARN [BP-1207415590-172.31.14.131-1676714507388 heartbeating to localhost/127.0.0.1:40077] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 10:01:53,122 WARN [BP-1207415590-172.31.14.131-1676714507388 heartbeating to localhost/127.0.0.1:40077] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1207415590-172.31.14.131-1676714507388 (Datanode Uuid cf553ca1-5a40-491d-a201-241c708ba16c) service to localhost/127.0.0.1:40077 2023-02-18 10:01:53,122 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/dfs/data/data1/current/BP-1207415590-172.31.14.131-1676714507388] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:53,123 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/488de534-cab3-8a70-a517-887ef7fe3d60/cluster_4d4da700-5725-c361-e391-ce54472f2986/dfs/data/data2/current/BP-1207415590-172.31.14.131-1676714507388] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 10:01:53,133 INFO [Listener at localhost/39743] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 10:01:53,245 INFO [Listener at localhost/39743] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 10:01:53,261 INFO [Listener at localhost/39743] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 10:01:53,275 INFO [Listener at localhost/39743] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 271) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34329,1676714508007)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39743 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:40077 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:40077 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40077 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:40077 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:40077 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (494579167) connection to localhost/127.0.0.1:40077 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:40077 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=595 (was 580) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 187) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8564 (was 8548) - AvailableMemoryMB LEAK? -